Related Experiment Video
Updated: Jul 19, 2026
08:42
A Familiarization Protocol Facilitates the Participation of Children with ASD in Electrophysiological Research
Published on: July 31, 2017
Reliability issues and solutions for coding social communication performance in classroom settings
Lesley B Olswang1, Liselotte Svensson, Truman E Coggins
1Department of Speech and Hearing Sciences, University of Washington, 1417 Northeast 42nd Street, Seattle, WA 98105-6246l, USA. lolswang@u.washington.edu
Journal of Speech, Language, and Hearing Research : JSLHR
|November 2, 2006
Summary
Time-interval analysis reliably measures social communication in children. This method accurately captures both the occurrence and duration of behaviors, proving effective for classroom observations.
Area of Science:
- Child Psychology
- Behavioral Science
- Educational Technology
Background:
- Accurate measurement of children's social communication is crucial for understanding development and informing interventions.
- Existing methods for coding social communication behaviors often struggle with reliability, particularly in capturing both occurrence and duration.
- Observational studies in classroom settings require robust methods to ensure data quality and consistency.
Purpose of the Study:
- To evaluate the effectiveness of time-interval analysis for reliably coding children's social communication behaviors in classrooms.
- To determine if independent observers can consistently assess both the presence and length of social communication dimensions.
- To introduce a novel approach for enhancing the reliability of observational data in child behavior research.
Main Methods:
- Four coders independently assessed 6 social communication dimensions using handheld computers capable of recording frequency and duration.
- Data were derived from 20 two-minute video segments of children in kindergarten through 3rd grade.
- Interobserver and intraobserver reliability were analyzed using time-interval sorting and Cohen's kappa, with variations in interval size and observation length.
Main Results:
- Time-interval analysis combined with Cohen's kappa proved effective for assessing the reliability of coding both occurrence and duration of social communication behaviors.
- Most comparisons demonstrated medium to large kappa values, indicating high agreement among observers.
- The chosen interval size and total observation length had minimal impact on the reliability outcomes.
Conclusions:
- The developed time-interval analysis procedure offers a reliable solution for comparing coding of behavior occurrence and duration by independent observers.
- The study validates a new coding taxonomy and technology suitable for real-time online observations of social communication in educational environments.
- This methodology enhances the precision and trustworthiness of behavioral data collected in classroom settings.
Related Concept Videos
01:20Social Foundations of Self II: The Generalized Other
According to George Herbert Mead, as children progress beyond the game stage, they develop a more comprehensive understanding of societal rules and norms. This cognitive and social development enables them to internalize the expectations of the broader community, refining their ability to regulate behavior.Consistent participation in organized activities is crucial in helping children recognize that their actions are not isolated but contribute to a more significant, interconnected group effort.
01:21Barriers to Effective Communication II
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
01:26Modeling in Therapy
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
01:30Barriers to Effective Communication I
A communication barrier is any distortion or interruption during a conversation, resulting in miscommunication of the message. A good communicator should know these barriers and continuously check for the listener's understanding by obtaining feedback.
Communication barriers include the following:
Physiological barriers: They are limitations caused by a person's health condition or disability, such as hearing loss, poor eyesight, illness, or unconsciousness. An example to overcome this barrier...
Communication barriers include the following:
Physiological barriers: They are limitations caused by a person's health condition or disability, such as hearing loss, poor eyesight, illness, or unconsciousness. An example to overcome this barrier...
01:29Factors Influencing Attraction V: Social Skills
Social skills play a crucial role in shaping interpersonal interactions and enhancing individuals' ability to navigate various social environments successfully. These skills contribute to personal and professional success, influencing how others perceive and treat individuals. High social skills provide distinct advantages in numerous settings, including romantic relationships, politics, and legal proceedings. In courtroom settings, for instance, defendants who exhibit strong social skills are...
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.