Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Differences between scorers on selected language measures

J R Cox, G S Cox

    Journal of Communication Disorders
    |March 1, 1981
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Corrigendum to "Rational engineering of an improved adenosine deaminase 2 enzyme for weaponizing T-cell therapies": [Immuno-Oncology and Technology 10 (2023) 100394].

    Immuno-oncology technology·2023
    Same author

    Rational engineering of an improved adenosine deaminase 2 enzyme for weaponizing T-cell therapies.

    Immuno-oncology technology·2023
    Same author

    Mobile Stroke Unit Reduces Time to Image Acquisition and Reporting.

    AJNR. American journal of neuroradiology·2018
    Same author

    Assembly of high-areal-density deuterium-tritium fuel from indirectly driven cryogenic implosions.

    Physical review letters·2012
    Same author

    Demonstration of ignition radiation temperatures in indirect-drive inertial confinement fusion hohlraums.

    Physical review letters·2011
    Same author

    A clinical study comparing marginal and occlusal accuracy of crowns fabricated from double-arch and complete-arch impressions.

    Australian dental journal·2005
    Same journal

    State of the art in speech perception assessment.

    Journal of communication disorders·2026
    Same journal

    Clinicians' perspectives and experiences on using consistent terminology in speech-language pathology: A qualitative study.

    Journal of communication disorders·2026
    Same journal

    Divergent Cognitive-Linguistic Mechanisms in Mandarin Sentence Recognition: The Impact of F0 Contour and Noise in Children With and Without Developmental Language Disorder.

    Journal of communication disorders·2026
    Same journal

    Speech-language service utilization by families with young children: The role of social determinants of health.

    Journal of communication disorders·2026
    Same journal

    Effectiveness and stability of differential interventions in mitigating negative attitudes of Indian university students toward stuttering.

    Journal of communication disorders·2026
    Same journal

    Expressive language growth among young children who do and do not stutter.

    Journal of communication disorders·2026
    See all related articles

    Speech-language pathologists show significant score variations in language sample analysis, impacting reliability. Even non-significant differences reveal substantial scorer discrepancies across all measures.

    Area of Science:

    • Speech-Language Pathology
    • Linguistics
    • Psychometrics

    Background:

    • Reliability in language sample analysis is crucial for accurate assessment.
    • Inter-rater reliability is a key concern in speech-language pathology evaluations.
    • Standardized scoring procedures aim to minimize variability in language assessments.

    Purpose of the Study:

    • To investigate inter-scorer reliability among speech-language pathologists using specific language sample analysis measures.
    • To identify which language sample assessment procedures exhibit significant score differences between raters.
    • To determine the extent of scorer variability across multiple quantitative and qualitative language measures.

    Main Methods:

    • Analysis of 96 language samples scored by five speech-language pathologists.

    Related Experiment Videos

  • Utilized assessments included total words, total sentences, words per sentence, syntax quotient (usage and endings), syntax quotient (structures), and an abstract-concrete scale.
  • Statistical analysis to determine inter-scorer differences.

    • Main Results:

    • Statistically significant inter-scorer differences were found for words per sentence, syntax quotient (usage and endings), and the abstract-concrete scale.
    • While mean differences for total words, total sentences, and syntax quotient (structures) were not statistically significant, substantial absolute differences were observed across all six measures.
    • This indicates considerable variability in scoring among speech-language pathologists.

    Conclusions:

    • Significant inter-scorer variability exists in language sample analysis, particularly for specific syntactic and abstract-concrete measures.
    • Substantial absolute differences, even when not statistically significant, highlight potential clinical implications for accurate language assessment.
    • Further research and refinement of scoring protocols are needed to enhance the reliability of language sample analysis in speech-language pathology.