Related Concept Videos
Automatic Processing and Automatic Social Behavior
Predicting Molecular Geometry
Emerging Adulthood
Protein and Protein Structure
A protein's shape is critical to its function. For example, an enzyme...
Introduction Cardiac Emergencies
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
You might also read
Related Articles
Articles linked to this work by shared authors, journal, and citation graph.
Spatial versus graphical representation of distributional semantic knowledge.
Evidence of disturbances of deep levels of semantic cohesion within personal narratives in schizophrenia.
Organizing the space and behavior of semantic models.
Related Experiment Video
Updated: Feb 13, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
Structured Semantic Knowledge Can Emerge Automatically from Predicting Word Sequences in Child-Directed Speech.
Philip A Huebner1, Jon A Willits2
1Interdepartmental Neuroscience Graduate Program, University of California, Riverside, Riverside, CA, United States.
Recurrent neural networks trained on child-directed speech learn abstract semantic knowledge, challenging prior criticisms of deep learning models for abstract knowledge acquisition.
More Related Videos
07:56Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure
Published on: September 19, 2019
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
Area of Science:
- Cognitive Science
- Computational Linguistics
- Artificial Intelligence
Background:
- Distributional learning mechanisms are proposed for semantic knowledge acquisition.
- Deep learning models face criticism for lacking abstract and structured knowledge capabilities.
Purpose of the Study:
- To investigate if recurrent neural networks can learn abstract and structured semantic knowledge from naturalistic speech.
- To compare the semantic knowledge acquired by different neural network architectures.
Main Methods:
- Trained Simple Recurrent Network (SRN) and Long Short-Term Memory (LSTM) models on a 5-million-word corpus of child-directed speech (ages 0-3).
- Assessed acquired semantic knowledge by analyzing internal representations and similarity structures.
- Compared performance with a non-recurrent Skip-gram model, a state-of-the-art machine learning approach.
Main Results:
- Both SRN and LSTM models learned abstract grammatical and semantic features for word sequence prediction.
- Evidence of emergent categorical and hierarchical semantic structures was found in both recurrent models.
- LSTM outperformed SRN quantitatively, while Skip-gram showed similar performance but with more thematic word representations.
Conclusions:
- Recurrent neural networks can acquire abstract and structured semantic knowledge from naturalistic language input.
- Learned representations offer insights into the emergence of semantic systems in child language acquisition.
- The findings challenge limitations previously attributed to deep learning in acquiring abstract knowledge.