Related Experiment Video
Updated: Jan 23, 2026

A Computerized Functional Skills Assessment and Training Program Targeting Technology Based Everyday Functional Skills
Published on: February 13, 2020
Reliability, validity, and accuracy of the intervention selection profile-Function: A brief functional assessment
Stephen P Kilgus1, Nathaniel P von der Embse2, Katie Eklund1
1Department of Educational Psychology.
The Intervention Selection Profile-Function (ISP-Function) shows promise for assessing disruptive behavior and consequences, but further research is needed to confirm its accuracy and reliability for all targeted behaviors.
Area of Science:
- Educational Psychology
- Behavioral Analysis
- Psychometrics
Background:
- Direct Behavior Rating (DBR) is a methodology for behavioral assessment.
- The Intervention Selection Profile-Function (ISP-Function) is a brief tool utilizing DBR.
- Evaluating the psychometric properties of assessment tools is crucial for their effective application.
Purpose of the Study:
- To assess the reliability, validity, and accuracy of the ISP-Function.
- To determine the psychometric soundness of a DBR-based functional assessment tool.
- To compare ISP-Function ratings with Systematic Direct Observation (SDO) data.
Main Methods:
- 34 teacher-student dyads participated.
- Teachers used the ISP-Function to rate disruptive behavior and consequences.
- Systematic Direct Observation (SDO) data were collected concurrently.
- Temporal reliability, correlations with SDO, and score agreement were analyzed.
Main Results:
- Adequate temporal reliability was found for adult and peer attention targets.
- Correlations with SDO data were moderate to high for disruptive behavior, adult, and peer attention.
- Low correlations were observed for access/avoidance targets.
- Accuracy varied, with mean score differences between 0.33 and 1.81 on a 0-10 scale.
Conclusions:
- The ISP-Function demonstrates promising reliability and validity for certain behavioral targets.
- Further research is required to enhance the accuracy and consistency of the ISP-Function for all targets.
- The tool shows potential for supporting intervention selection in educational settings.
Related Concept Videos
Reliability and Validity
Nursing Interventions II: Selecting and Classifying the Nursing Interventions
Functional Groups
Functional Groups
Functionalism
James envisioned psychology's...
Mechanical Protein Functions

