Related Experiment Video
Updated: Jan 19, 2026
Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure
Published on: September 19, 2019
Detecting substance-related problems in narrative investigation summaries of child abuse and neglect using text
Brian E Perron1, Bryan G Victor2, Gregory Bushman1
1Child and Adolescent Data Lab, University of Michigan, School of Social Work, 1080 S University Ave, Ann Arbor, MI, 48109, United States.
Background:
State child welfare agencies collect, store, and manage vast amounts of data. However, they often do not have the right data, or the data is problematic or difficult to inform strategies to improve services and system processes. Considerable resources are required to read and code these text data. Data science and text mining offer potentially efficient and cost-effective strategies for maximizing the value of these data.
Objective:
The current study tests the feasibility of using text mining for extracting information from unstructured text to better understand substance-related problems among families investigated for abuse or neglect.
Method:
A state child welfare agency provided written summaries from investigations of child abuse and neglect. Expert human reviewers coded 2956 investigation summaries based on whether the caseworker observed a substance-related problem. These coded documents were used to develop, train, and validate computer models that could perform the coding on an automated basis.
Results:
A set of computer models achieved greater than 90% accuracy when judged against expert human reviewers. Fleiss kappa estimates among computer models and expert human reviewers exceeded .80, indicating that expert human reviewer ratings are exchangeable with the computer models.
Conclusion:
These results provide compelling evidence that text mining procedures can be a cost-effective and efficient solution for extracting meaningful insights from unstructured text data. Additional research is necessary to understand how to extract the actionable insights from these under-utilized stores of data in child welfare.
Related Concept Videos
07:56Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure
07:15Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
04:04Asthma Detection Research Based on Voice Signal Processing and Machine Learning
10:43Eye-tracking Technology and Data-mining Techniques used for a Behavioral Analysis of Adults engaged in Learning Processes
06:19Constructing and Visualizing Models using Mime-based Machine-learning Framework
05:04A Common Marmoset Model of Mother-Infant Intervention for Breastfeeding Disorders in the Presence of Paternal Inhibition and Maternal Neglect