Related Experiment Video
Updated: Mar 31, 2026

Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Improving IQ measurement in intellectual disabilities using true deviation from population norms
Stephanie M Sansone1, Andrea Schneider2, Erika Bickel1
1Medical Investigation of Neurodevelopmental Disorders (MIND) Institute, University of California at Davis Medical Center, 2825 50th Street, Sacramento, CA 95817, USA.
This study introduces a new scoring method for IQ tests that better captures cognitive differences in people with intellectual disabilities. By using raw z-scores instead of standard IQ scores, researchers can avoid measurement errors that often hide individual strengths and weaknesses in lower-functioning groups.
Area of Science:
- Psychometric evaluation of IQ measurement in intellectual disabilities
- Neurodevelopmental disorders research within clinical psychology
Background:
Standardized intelligence testing often fails to capture the full range of cognitive ability in individuals with significant impairments. That uncertainty drove researchers to investigate why traditional scoring methods frequently produce inaccurate results for these populations. Prior research has shown that standard IQ metrics often suffer from floor effects, which artificially compress performance data. No prior work had resolved how to effectively recover this lost information for clinical or research purposes. This gap motivated the development of a transformation technique based on general population norms. The current approach seeks to address these limitations by providing a more precise way to quantify cognitive performance. Experts have long recognized that existing assessment tools lack the necessary sensitivity for lower-functioning individuals. This study builds upon established psychometric theory to refine how we interpret test data for neurodevelopmental conditions.
Purpose Of The Study:
The study aims to improve the precision of cognitive assessment for individuals with intellectual disabilities. Researchers sought to address the limited range and accuracy of traditional IQ tests within this population. The authors identified that standard scoring methods often fail to capture meaningful differences in cognitive ability. This problem is particularly acute for individuals who perform at the lower end of the ability spectrum. The team hypothesized that a raw z-score transformation based on general population norms would ameliorate existing floor effects. They intended to demonstrate that this method recovers lost information regarding individual cognitive strengths and weaknesses. By comparing this approach with conventional metrics, the investigators aimed to validate its utility for clinical and research applications. This work was motivated by the need for more accurate assessment tools in the context of neurodevelopmental conditions.
Main Methods:
The researchers conducted a comparative analysis of two distinct scoring procedures using existing test data. They applied a raw z-score transformation derived from general population norms to the collected performance metrics. The team evaluated the Stanford Binet 5 results from cohorts of individuals with fragile X syndrome and autism spectrum disorder. Review approach involved generating Q-Q plots to visualize the distributional characteristics of both standardized and deviation scores. The investigators examined how each method correlated with multiple external criterion measures to assess predictive validity. They calculated the variance accounted for by each scoring system to determine the degree of information recovery. This systematic comparison highlighted the limitations of conventional scaled scores in capturing cognitive diversity. The study design focused on quantifying the precision gains achieved through the proposed transformation technique.
Main Results:
The researchers found that substantial cognitive variation is lost when converting raw data into standard scaled, index, or IQ scores. This loss of information is particularly evident among individuals with intellectual disabilities who exhibit lower functioning. The deviation z-score method successfully rectifies these inaccuracies by accounting for significant additional variance in criterion validation measures. This approach allows for the recovery of both individual and group-level cognitive strengths and weaknesses that were previously obscured. The study demonstrated that traditional scoring methods produce erroneously flat profiles for these specific populations. By measuring true deviation from standardization sample norms, the authors achieved a more precise assessment of cognitive abilities. The results indicate that the new method outperforms conventional metrics in capturing the full range of performance. These findings provide evidence that current assessment practices require refinement to accurately reflect the cognitive status of impaired individuals.
Conclusions:
The authors propose that their deviation z-score approach offers a superior alternative to traditional standardized scoring systems. This method successfully mitigates the loss of cognitive variance typically observed in individuals with intellectual disabilities. By recovering individual and group-level performance profiles, the technique provides a clearer picture of specific cognitive strengths and weaknesses. The researchers suggest that standard IQ metrics are inadequate for accurately representing the abilities of lower-functioning participants. Their findings indicate that this transformation accounts for significant additional variance in external validation measures. This work implies that future test development should prioritize methods that maintain sensitivity across the entire ability spectrum. Clinical assessments may benefit from adopting these refined scoring procedures to ensure more accurate diagnostic outcomes. The authors conclude that their approach enhances the utility of intelligence testing for research involving neurodevelopmental disorders.
Frequently Asked Questions
The researchers propose a raw z-score transformation based on general population norms. This technique rectifies floor effects, allowing for the capture of meaningful cognitive variation that is otherwise lost when converting raw data into standard scaled or index scores.
The authors utilized the Stanford Binet 5 (SB5) as the primary instrument. This tool was applied to cohorts of 106 individuals with fragile X syndrome and 205 participants diagnosed with idiopathic autism spectrum disorder to validate the new scoring approach.
The authors argue that traditional scoring is necessary to avoid, as it creates erroneously flat profiles for lower-functioning individuals. By using deviation scores, the researchers demonstrate that they can recover nuanced performance data that standard methods fail to detect.
The researchers employed Q-Q plots and distributional characteristics to compare standardized scores against deviation z-scores. This data type allowed them to visualize how the new method accounts for additional variance in criterion validation measures.
The study measured the relationship between scoring methods and multiple criterion measures. The authors found that deviation scores explain significant additional variance, providing a more accurate representation of cognitive ability than standard IQ scores alone.
The researchers propose that their findings have implications for future standardized test development. They suggest that clinical and research settings should adopt these methods to improve the accuracy of cognitive impairment assessments in neurodevelopmental populations.
More Related Videos
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
Related Concept Videos
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Intellectual Disability
Wechsler's Contribution to Measures of Intelligence
Binet's Contribution to Measures of Intelligence
Environmental Influences on Intelligence
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...