Singing Ability Assessment: Development and validation of a singing test based on item response theory and a general...

Area of Science:

• Music Cognition
• Psychometrics
• Computational Auditory Processing

Background:

• Assessing singing ability and melodic memory is crucial in music cognition and psychology.
• Existing methods often lack standardized, open-source tools for robust online and laboratory assessment.
• Understanding the psychometric properties of singing performance is an ongoing research area.

Purpose of the Study:

• To develop and validate the Singing Ability Assessment (SAA), an open-source test environment for measuring human singing ability and melodic memory.
• To investigate the underlying dimensions of singing long notes and factors influencing melodic recall accuracy.
• To provide accessible computational tools for researchers studying singing and auditory memory.

Main Methods:

• Development of the SAA open-source test environment, incorporating on-the-fly audio transcription via a probabilistic algorithm.
• Application of latent variable approaches and item response theory for scoring singing performance.
• Conducting two online experiments (N = 247; N = 910) to gather singing data and validate the assessment.
• Utilizing principal component analysis for long note singing and mixed-effects models for melodic recall.

Main Results:

• Principal component analysis revealed three dimensions of long note singing: pitch accuracy, pitch volatility, and pitch stability.
• Mixed-effects models explained significant variance in melodic recall performance (R²c = .42 for overall, R²c = .42 rhythmic, R²c = .38 arhythmic).
• SAA melodic scores demonstrated significant associations with established singing accuracy measures, demographic variables, and hardware configurations.

Conclusions:

• The Singing Ability Assessment (SAA) provides a reliable and valid open-source measure of singing ability and melodic memory.
• The study identified key dimensions of singing performance and factors influencing melodic recall.
• Five associated R packages are released to facilitate the deployment and analysis of singing and melodic memory tests in research settings.