Related Experiment Video
Updated: Jul 20, 2026
08:40
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Interrater and test-retest reliability of a fixed condition design fluency test
Lisle R Kingery1, David J Schretlen, Sara Sateri
1Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
The Clinical Neuropsychologist
|September 19, 2006
Summary
The Design Fluency Test (DFT) now has reliable administration and scoring methods. This neuropsychological test demonstrates good to excellent reliability, making it suitable for research and clinical use.
Area of Science:
- Neuropsychology
- Cognitive Psychology
- Psychometrics
Background:
- The Design Fluency Test (DFT) has potential as a neuropsychological tool.
- Its research foundation is limited by inconsistent administration and scoring, and a lack of reliability data.
Purpose of the Study:
- To describe a standardized method for administering and scoring the fixed condition DFT.
- To assess the interrater and long-term test-retest reliability of the DFT using the described procedures.
Main Methods:
- A standardized administration and scoring protocol for the fixed condition DFT was developed.
- Interrater reliability was assessed by five raters scoring 50 DFT protocols.
- Test-retest reliability was evaluated in 87 healthy adults tested over an average of 5.5 years.
Main Results:
- Good to excellent intra-class correlation coefficients were achieved for all DFT scores, indicating high interrater reliability.
- Test-retest reliabilities for total and novel design scores ranged from good to excellent.
- The reliability of the DFT is comparable to other established neuropsychological tests.
Conclusions:
- The described procedures provide a reliable method for scoring the fixed condition DFT.
- The DFT demonstrates strong psychometric properties, supporting its use in neuropsychological assessment and research.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
01:09Comparing Experimental Results: Student's t-Test
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
01:15Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
01:17Cochran's Q Test
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
01:23McNemar's Test
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...