Related Experiment Video
Updated: Jul 19, 2026

Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms
Published on: February 8, 2019
Towards an AI-driven soft toy for automatically detecting and classifying infant-toy interactions using optical force
Rithwik Udayagiri1,2, Jessica Yin2,3, Xinyao Cai2
1Rehabilitation Robotics Lab (A GRASP Lab), University of Pennsylvania, Philadelphia, PA, United States.
Insights
This study introduces a novel sensor-equipped toy to detect infant neurodevelopmental delays. Machine learning accurately classified infant interactions, showing potential for early detection of motor delays.
Area of Science:
- Biomedical Engineering
- Developmental Pediatrics
- Machine Learning
Background:
- Early identification of neurodevelopmental disorders in infants is critical for effective intervention and improved long-term outcomes.
- Quantitative assessment of infant-toy interactions during natural play offers a promising approach for early detection of developmental delays.
- Prior research indicates distinct toy interaction patterns between full-term and at-risk preterm infants.
Purpose of the Study:
- To design and develop an automated toy system for quantitative assessment of infant-toy interactions.
- To detect infants at risk for motor delays through analysis of play interaction data.
- To evaluate the efficacy of soft force sensors and machine learning in classifying infant actions.
Main Methods:
- Development of a novel toy incorporating soft, lossy force sensors made from optical fibers.
- Collection of an interaction database (2480 interactions) from 15 adults simulating infant play (touches, weak grasps, strong grasps, kicks).
- Utilizing a machine learning model to analyze sensor data and classify interaction types.
Main Results:
- The configuration of 6 soft force sensors on the toy generated unique activation patterns.
- The machine learning algorithm successfully identified distinct interaction types from the collected data.
- These findings suggest the toy's potential for accurate classification of infant actions.
Conclusions:
- The developed sensorized toy demonstrates potential for automated, quantitative assessment of infant-toy interactions.
- The system shows promise for early detection of neurodevelopmental and motor delays in infants.
- Future work includes full toy sensorization and testing with infants.
Abstract:
Introduction: It is crucial to identify neurodevelopmental disorders in infants early on for timely intervention to improve their long-term outcomes. Combining natural play with quantitative measurements of developmental milestones can be an effective way to swiftly and efficiently detect infants who are at risk of neurodevelopmental delays. Clinical studies have established differences in toy interaction behaviors between full-term infants and pre-term infants who are at risk for cerebral palsy and other developmental disorders. Methods: The proposed toy aims to improve the quantitative assessment of infant-toy interactions and fully automate the process of detecting those infants at risk of developing motor delays. This paper describes the design and development of a toy that uniquely utilizes a collection of soft lossy force sensors which are developed using optical fibers to gather play interaction data from infants laying supine in a gym. An example interaction database was created by having 15 adults complete a total of 2480 interactions with the toy consisting of 620 touches, 620 punches-"kick substitute," 620 weak grasps and 620 strong grasps. Results: The data is analyzed for patterns of interaction with the toy face using a machine learning model developed to classify the four interactions present in the database. Results indicate that the configuration of 6 soft force sensors on the face created unique activation patterns. Discussion: The machine learning algorithm was able to identify the distinct action types from the data, suggesting the potential usability of the toy. Next steps involve sensorizing the entire toy and testing with infants.
Related Concept Videos
Force Classification
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Automatic Processing and Automatic Social Behavior

