Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Thinking Critically About Algorithms for Automated Detection of Behavior: 11 Guidelines for Social and Behavioral Scientists.

Developmental science·2026
Same author

Caregiver Holding, Not Vocalizing, Supports Real-Time Vagal Regulation.

Infancy : the official journal of the International Society on Infant Studies·2025
Same author

Spatial and seasonal distribution, sources, and health risks of PM<sub>2.5</sub> loaded per- and polyfluoroalkyl substances (PFASs) in a typical megacity.

The Science of the total environment·2024
Same author

Strategies to Implement a Community-Based, Longitudinal Cohort Study: The Whole Communities-Whole Health Case Study.

JMIR formative research·2024
Same author

Mothers speak less to infants during detected real-world phone use.

Child development·2024
Same author

A transcription factor-mediated regulatory network controls fungal pathogen colonization of insect body cavities.

mBio·2024
Same journal

The Rhythm Reproduction Task for children: A psychometric examination.

Behavior research methods·2026
Same journal

QualGames: A Qualtrics implementation and a database of behavioral game theory tasks.

Behavior research methods·2026
Same journal

PyLossless: A non-destructive EEG processing pipeline.

Behavior research methods·2026
Same journal

"It makes sense to me": Examining data file column names in the visual cognitive literature.

Behavior research methods·2026
Same journal

Planned missingness in intensive longitudinal studies: Extensions and comparisons of multiform designs.

Behavior research methods·2026
Same journal

A validity-guided workflow for robust large language model research in psychology.

Behavior research methods·2026
See all related articles

Related Experiment Video

Updated: Aug 29, 2025

Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

16.5K

Validating a model to detect infant crying from naturalistic audio.

Megan Micheletti1, Xuewen Yao2, Mckensey Johnson3

  • 1Department of Psychology, The University of Texas at Austin, 108 E Dean Keeton St, Austin, TX, 78712, USA. m.micheletti@utexas.edu.

Behavior Research Methods
|September 10, 2022
PubMed
Summary
This summary is machine-generated.

This study evaluates a new computer program designed to automatically identify baby cries in long recordings from home environments. Researchers compared this tool against a standard commercial system and human listeners. The new model proved more accurate at spotting cries across various timeframes. These findings help scientists better track infant vocalizations in natural settings.

Keywords:
Computational modelDeep learningInfant cryingNaturalisticautomated detectionacoustic analysisdevelopmental psychologybehavioral monitoring

Frequently Asked Questions

More Related Videos

Behavioral Assessment of Hearing in 2 to 4 Year-old Children: A Two-interval, Observer-based Procedure Using Conditioned Play-based Responses
14:05

Behavioral Assessment of Hearing in 2 to 4 Year-old Children: A Two-interval, Observer-based Procedure Using Conditioned Play-based Responses

Published on: January 23, 2017

29.2K
Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
05:35

Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization

Published on: April 19, 2017

6.8K

Related Experiment Videos

Last Updated: Aug 29, 2025

Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

16.5K
Behavioral Assessment of Hearing in 2 to 4 Year-old Children: A Two-interval, Observer-based Procedure Using Conditioned Play-based Responses
14:05

Behavioral Assessment of Hearing in 2 to 4 Year-old Children: A Two-interval, Observer-based Procedure Using Conditioned Play-based Responses

Published on: January 23, 2017

29.2K
Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
05:35

Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization

Published on: April 19, 2017

6.8K

Area of Science:

  • Developmental psychology research within infant cry detection methodology
  • Computational linguistics and signal processing in behavioral science

Background:

No prior work had resolved how automated tools perform across entire days of home audio. Prior research has shown that vocal signals from babies are vital for eliciting parental attention. That uncertainty drove the need for rigorous testing of detection software in real-world settings. Existing algorithms often lack validation against long-duration naturalistic data. This gap motivated the current assessment of machine learning performance. Scientists have long relied on commercial software despite limited evidence regarding its precision. Previous studies frequently utilized short, controlled clips rather than continuous recordings. Such limitations hindered the ability to accurately quantify vocalization patterns in domestic environments.

Purpose Of The Study:

The aim of this research is to validate a novel deep learning model for detecting infant vocalizations. Investigators sought to address the lack of thorough evaluation for such tools in naturalistic settings. They specifically targeted the performance gap between custom algorithms and commonly used commercial software. The study explores how these models function when applied to daylong audio recordings from homes. Researchers intended to provide a reliable solution for developmental scientists monitoring child behavior. They also examined the discrepancy between automated detection results and subjective parent-report data. By comparing these methods, the team hoped to establish a more precise standard for quantifying distress. This work serves to improve the rigor of longitudinal studies in the field of developmental psychology.

Main Methods:

Review approach involved validating a novel computational model against existing commercial software. The team utilized extensive naturalistic audio recordings collected from home environments. They performed comparative analyses across three distinct temporal windows. Human annotators manually coded these audio files to establish a gold standard. The investigators calculated specific statistical metrics including recall and kappa coefficients. They assessed the commercial system alongside their custom algorithm to determine relative performance. The study design prioritized transparency by making all training data and source code publicly accessible. This methodology ensured that other scientists could replicate the findings and improve upon the current detection framework.

Main Results:

Key findings from the literature demonstrate that the deep learning model achieved superior accuracy metrics compared to the commercial software. The custom algorithm showed stronger correlations with human annotations at every tested timescale. LENA underestimated total daily vocalization time by 50 minutes per 24-hour period. Both automated systems produced lower daily estimates than those reported by parents in previous literature. The deep learning approach exhibited higher recall and F1 scores in all assessment scenarios. Convergent validity was observed between both automated outputs and manual human coding. The data indicate that the new model effectively captures distress signals in complex home audio. These results highlight the limitations of current commercial tools for longitudinal developmental research.

Conclusions:

The authors propose that their deep learning framework offers superior precision compared to existing commercial alternatives. Synthesis and implications suggest that automated tools require validation against human-annotated ground truth. Researchers claim that current software systems may significantly underestimate total daily vocalization durations. The team emphasizes that both automated approaches demonstrate convergent validity with manual coding efforts. They suggest that future studies should prioritize open-source code to improve transparency in behavioral analysis. The authors note that parent-reported estimates often diverge from objective machine-based measurements. They provide specific guidance for investigators seeking to implement these tools in home-based research. The findings indicate that machine learning models represent a robust advancement for longitudinal developmental monitoring.

The researchers propose that the deep learning model achieves higher recall, F1 scores, and kappa coefficients. While the commercial LENA software misses approximately 50 minutes of crying per day, the new algorithm maintains stronger correlations with human-labeled data across all tested temporal scales.

The study utilizes a deep learning architecture trained on naturalistic audio. This approach differs from the LENA classifier, which relies on proprietary commercial algorithms designed for quantifying child-centered acoustic environments rather than specific distress signals.

The authors state that validation across 24-hour, 1-hour, and 5-minute intervals is necessary to ensure reliability. These distinct timescales allow researchers to capture both brief distress episodes and broader daily patterns of vocal behavior in domestic settings.

The researchers use human-annotated audio as the ground truth to calculate accuracy metrics. This manual coding serves as the benchmark for evaluating how well automated systems identify genuine infant distress versus background noise.

The study measures recall, F1 scores, and Cohen's kappa to quantify model precision. These metrics reveal that the deep learning approach consistently outperforms the commercial alternative in identifying infant vocalizations within home audio recordings.

The authors suggest that automated tools should be used alongside parent reports to gain a complete picture. They propose that relying solely on subjective caregiver estimates may lead to inaccurate conclusions regarding infant distress frequency.