Related Experiment Video
Updated: Jan 19, 2026
Ultrasound Images of the Tongue: A Tutorial for Assessment and Remediation of Speech Sound Errors
Published on: January 3, 2017
Statistical considerations for crowdsourced perceptual ratings of human speech productions
Daniel Fernández1,2, Daphna Harel3,4, Panos Ipeirotis5
1Institut de Recerca Sant Joan de Déu, Parc Sanitari Sant Joan de Deu, CIBERSAM, Spain.
Abstract:
Crowdsourcing has become a major tool for scholarly research since its introduction to the academic sphere in 2008. However, unlike in traditional laboratory settings, it is nearly impossible to control the conditions under which workers on crowdsourcing platforms complete tasks. In the study of communication disorders, crowdsourcing has provided a novel solution to the collection of perceptual ratings of human speech production. Such ratings allow researchers to gauge whether a treatment yields meaningful change in how human listeners' perceive disordered speech. This paper will explore some statistical considerations of crowdsourced data with specific focus on collecting perceptual ratings of human speech productions. Random effects models are applied to crowdsourced perceptual ratings collected in both a continuous and binary fashion. A simulation study is conducted to test the reliability of the proposed models under differing numbers of workers and tasks. Finally, this methodology is applied to a data set from the study of communication disorders.
Related Concept Videos
08:32Ultrasound Images of the Tongue: A Tutorial for Assessment and Remediation of Speech Sound Errors
01:23Marketing Considerations for Consumer Products
For convenience products, like Fast Moving Consumer Goods, the emphasis is often on accessibility and affordability. These products are usually low-priced and widely available. The promotion focuses on creating brand recognition.
Shopping products, like electronics, require a more...
07:34Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues
01:50Statistical Significance
06:48The Staircase Procedure for Finding a Perceptual Threshold
Psychophysics is the name for a set of methods in perceptual psychology designed in order to relate the actual intensity of stimuli to their perceptual intensity. One important aspect of psychophysics involves the measurement of perceptual thresholds: How bright does a light need to be for a person to be able to detect it? How little pressure applied to the skin is detectable? How soft can a sound be and still be heard? Put...
10:45Finding Your Blind Spot and Perceptual Filling-in
In the back of everyone's eye is a small piece of neural tissue called the retina. The retina has photosensitive cells that respond to stimulation by light. The responses of these cells are sent into the brain through the optic nerve, a bundle of neural fibers. In each retina there is a place somewhere in the periphery where the outputs from retinal cells collect and the bundled optic nerve exits to the brain. At that...