ChildLens: An egocentric video dataset for activity analysis in children

Nele-Pauline Suffo1, Pierre-Etienne Martin2, Anas Suffo3

  • 1Institute of Psychology in Education, Leuphana University Lüneburg, Universitätsallee 1, 21335, Lüneburg, Germany. nele.suffo@leuphana.de.

Insights

ChildLens is a new dataset capturing children's daily activities using egocentric video and audio. This rich data advances AI for studying child development.

Area of Science:

  • Computer Vision
  • Audio Analysis
  • Developmental Psychology

Background:

  • Understanding child development requires analyzing naturalistic everyday experiences.
  • Existing datasets often lack detailed, multimodal annotations of young children's activities.

Purpose of the Study:

  • To introduce ChildLens, a novel egocentric video and audio dataset.
  • To provide rich annotations for activities of children aged 3-5 years in their natural home environment.
  • To facilitate research in computer vision, audio analysis, and child development.

Main Methods:

  • Recorded 109 hours of egocentric video and audio from 62 children (aged 3-5).
  • Utilized a wide-lens camera and microphone integrated into a child-friendly vest.
  • Annotated data with five location and 14 activity classes, including audio-only, video-only, and multimodal instances.

Main Results:

  • Demonstrated benchmark performance of state-of-the-art models (Boundary-Matching Network, Voice Type Classifier) on the dataset.
  • Validated the quality of annotations through successful model evaluations.
  • Established ChildLens as a valuable resource for multimodal activity recognition.

Conclusions:

  • The ChildLens dataset offers a unique resource for studying child development through AI.
  • It removes a critical obstacle by providing detailed, naturalistic data.
  • The dataset will be freely available for research to advance AI and developmental studies.

Related Concept Videos

Vision During Infancy and Toddlerhood01:23

Vision During Infancy and Toddlerhood

At birth, vision is the least developed of the major senses because the visual system is still structurally and neurologically immature. The retinas, optic nerves, and visual regions of the brain continue to mature after birth. As a result, newborns have limited visual acuity, or sharpness and clarity of vision, and respond best to objects viewed at close range, roughly 8 to 12 inches away.Rapid Visual DevelopmentVision improves rapidly during the first few months as infants observe and...
Locomotion During Infancy and Toddlerhood01:29

Locomotion During Infancy and Toddlerhood

Children develop a wide range of gross motor skills during the first three years, as increasing muscle strength, balance, coordination, and nervous system maturation allow greater control over body movements. Development generally progresses from basic postural control to independent movement and later to activities such as jumping, climbing, and pedaling.Motor Development During the First YearMost infants begin rolling during the first several months, although the timing and direction can vary.
Sensorimotor Stage I: Substages 1 to 301:29

Sensorimotor Stage I: Substages 1 to 3

Piaget’s theory describes cognitive development as a sequence of stages. The first is the sensorimotor stage, which extends from birth to approximately two years. During this period, infants gain knowledge mainly through sensory experiences and motor actions. Over time, behavior progresses from automatic reflexes toward increasingly intentional and goal-oriented actions. The first three substages show the early part of this transition.Substage 1: Reflexive SchemesReflexive schemes span the...
Object Concept During Infancy and Toddlerhood01:26

Object Concept During Infancy and Toddlerhood

According to Piaget, the object concept is the understanding that objects exist as separate entities with their own characteristics and locations. An important part of this concept is object permanence, the understanding that an object continues to exist even when it is no longer visible. This ability develops gradually during the sensorimotor stage.Development of Object PermanenceAccording to Piaget, newborns do not yet show clear object permanence in search tasks. Between approximately five...
Imitation During Infancy and Toddlerhood01:27

Imitation During Infancy and Toddlerhood

Imitation is an important form of learning in early childhood, allowing children to learn new behaviors and participate in social interactions. Children imitate others for different purposes. They may copy adults and peers to learn skills and build social connections. Imitation becomes especially important toward the end of the first year.Early Development of ImitationPiaget observed that infants initially imitate actions they can see themselves perform, such as hand or foot movements. By about...
Socialization and Self-Regulation During Toddlerhood01:31

Socialization and Self-Regulation During Toddlerhood

Socialization is the developmental process through which children learn the habits, skills, values, and motives needed to function effectively in society. It begins within the family and later expands to peers, schools, and cultural institutions.From Compliance to InternalizationEarly socialization often involves compliance, in which children follow parental expectations to gain approval or rewards and avoid punishment. With development, compliance gradually shifts toward internalization, the...