Related Experiment Video
Updated: Mar 17, 2026

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Learning disability identification consistency: The impact of methodology and student evaluation data.
Kathrin E Maki1, Matthew K Burns2, Amanda Sullivan1
1Department of Educational Psychology, University of Minnesota.
School psychologists showed low consistency in identifying learning disabilities (LD). Identification consistency varied significantly based on the conclusiveness of student evaluation data, not the method used.
Area of Science:
- Educational Psychology
- Psychometrics
- Special Education
Background:
- Learning disability (LD) identification is a complex and evolving area within educational psychology.
- Previous research highlights inconsistencies in LD identification practices among professionals.
- Substantive reforms have aimed to standardize LD identification, yet challenges persist.
Purpose of the Study:
- To examine the consistency of school psychologists' learning disability identification decisions.
- To compare decision consistency across different LD identification methods.
- To investigate the impact of student evaluation data conclusiveness on LD identification.
Main Methods:
- Survey data collected from 376 practicing school psychologists across 22 states.
- Participants were randomly assigned to one of nine conditions, using a specific identification method and evaluating student data.
- Statistical analysis, including kappa coefficient and chi-square tests, was used to assess identification consistency.
Main Results:
- Overall identification consistency was found to be relatively low (73.7%, κ = .45).
- No significant differences in identification consistency were observed across the three identification methods used.
- Identification consistency was significantly influenced by the conclusiveness of the student evaluation data (p = .0001).
Conclusions:
- The study highlights a need for greater standardization in learning disability identification.
- The conclusiveness of student evaluation data is a critical factor influencing identification decisions.
- Further research and training are recommended to improve psychometric considerations and consistency in LD identification practices.
Related Concept Videos
Learning Disabilities
Dyslexia
Dyslexia is a...
Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Data Validation
Key parameters for method validation include:
Comparing Experimental Results: Student's t-Test

