Interrater reliability of the Technology Team Assessment Process

Area of Science:

• Educational Psychology
• Assistive Technology Research
• Special Education

Background:

• The Technology Team Assessment Process (TTAP) is a tool used to evaluate students.
• Assessing students with learning disabilities requires reliable and valid tools.
• Interrater reliability is crucial for consistent assessment outcomes.

Purpose of the Study:

• To evaluate the interrater reliability of the Technology Team Assessment Process (TTAP).
• To determine the consistency of TTAP assessments when used by different raters.

Main Methods:

• Five trained raters independently assessed videotaped TTAP evaluations of students aged 9-12 with learning disabilities.
• Raters used TTAP recording forms and made assistive technology recommendations.
• Interrater reliability was analyzed using intraclass correlation coefficients.

Main Results:

• Only one of the four investigated sections of the TTAP demonstrated acceptable interrater reliability.
• The majority of the TTAP sections showed insufficient agreement between raters.
• Assistive technology recommendations varied among raters.

Conclusions:

• The current version of the TTAP lacks sufficient interrater reliability for assessing students with learning disabilities.
• The TTAP requires significant further development and rigorous testing before clinical application.
• Concerns exist regarding the consistent application and interpretation of TTAP assessments.