Related Experiment Video
Updated: Aug 8, 2026
09:05
Assessing Working Memory in Children: The Comprehensive Assessment Battery for Children – Working Memory (CABC-WM)
Published on: June 12, 2017
Comparison of the test-retest reliability of the Work Box using three administrative methods
L Speller1, J A Trollinger, P A Maurer
1Pitt County Memorial Hospital, Greenville, North Carolina, USA.
Summary
The second revised Work Box instructions show the highest test-retest reliability, making them the recommended standard for assessing manual dexterity. This improved method is best suited for men with prior experience in such tasks.
Area of Science:
- Occupational therapy
- Rehabilitation medicine
- Human factors engineering
Background:
- The Work Box is a tool used to assess manual dexterity.
- Standardizing assessment methods is crucial for reliable results.
- Previous versions of the Work Box instructions had varying reliability.
Purpose of the Study:
- To compare the test-retest reliability of three administrative methods for the Work Box.
- To identify the most reliable set of instructions for Work Box administration.
Main Methods:
- Sixty subjects without disabilities were randomly assigned to one of three instruction groups (20 per group).
- The Work Box assessment was administered twice to each subject, with a 7-14 day interval between tests.
- Intraclass correlation coefficients (ICCs) were calculated to determine test-retest reliability.
Main Results:
- The second revised instructions yielded the highest ICCs for assembly (.781), disassembly (.579), and total scores (.717).
- Reliability was higher for men compared to women.
- Subjects with more experience in manual dexterity tasks showed higher reliability.
Conclusions:
- The second revised Work Box instructions are recommended as the standard administrative method due to superior reliability.
- The assessment appears most appropriate for men with existing manual dexterity experience.
- Further standardization could establish the Work Box as a valuable tool in industrial rehabilitation settings.
More Related Videos
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:13Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
01:19Kruskal-Wallis Test
The Kruskal-Wallis test, also known as the Kruskal-Wallis H test, serves as a nonparametric alternative to the one-way ANOVA, offering a solution for analyzing the differences across three or more independent groups based on a single, ordinal-dependent variable. This statistical test is particularly valuable in scenarios where the data does not meet the normal distribution assumption required by its parametric counterparts. Kruskal-Wallis test is designed typically to handle ordinal data or...
01:09Comparing Experimental Results: Student's t-Test
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
01:21Friedman Two-way Analysis of Variance by Ranks
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
01:22Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.