Dynamic Norming for Systematic Analysis of Language Transcripts

This exploratory study sought to establish the psychometric stability of a dynamic norming system using the Systematic Analysis of Language Transcripts (SALT) databases. Dynamic norming is the process by which clinicians select a subset of the normative database sample matched to their individual client's demographic characteristics.

The English Conversation and Student-Selected Story (SSS) Narrative databases from SALT were used to conduct the analyses in two phases. Phase 1 was an exploratory examination of the standard error of measure (SEM) of six clinically relevant transcript metrics at predetermined sampling intervals to determine (a) whether the dynamic norming process resulted in samples with adequate stability and (b) the minimum sample size required for stable results. Phase 2 was confirmatory, as random samples were taken from the SALT databases to simulate clinical comparison samples. These samples were examined (a) for stability of SEM estimations and (b) to confirm the sample size findings from Phase 1.

Results of Phase 1 indicated that the SEMs for the six transcript metrics across both databases were low relative to each metric's scale. Samples as small as 40-50 children in the Conversation database and 20-30 children in the SSS Narrative database resulted in stable SEM estimations. Phase 2 confirmed these findings, indicating that age bands as small as ±4 months from a given center-point resulted in stable estimations provided there were approximately 35 children or more in the comparison sample.

Psychometrically stable comparison samples can be achieved using SALT's dynamic norming system that are much smaller than the standard sample size recommended in most tests of children's language.