Related Experiment Videos
Mass data massage: an automated data processing system used for NHEXAS, Arizona. National Human Exposure Assessment
M K O'Rourke1, L M Fernandez, C N Bittel
1Environmental and Occupational Health Unit of the Arizona Prevention Center, The University of Arizona, Tucson 85721-0468, USA. maryk@hrp.arizona.edu
Journal of Exposure Analysis and Environmental Epidemiology
|November 30, 1999
Summary
A new Mass Data Massage system significantly reduces data entry errors and processing time for large surveys. This automated approach improves data accuracy and efficiency compared to traditional manual methods.
Area of Science:
- Data Science
- Information Management
- Survey Methodology
Background:
- Effective data entry and management are crucial for large-scale survey projects.
- Ensuring data quality and accessibility are primary objectives in survey research.
- Traditional manual data entry methods are often time-consuming and prone to errors.
Purpose of the Study:
- To develop and evaluate a comprehensive system for efficient and accurate data entry and management.
- To reduce systematic errors and improve the speed of data processing in survey projects.
- To assess the cost-effectiveness and accuracy of an automated data handling system compared to manual methods.
Main Methods:
- Development of the 'Mass Data Massage' (MDM) system, incorporating scannable forms with bubble fields and handwriting recognition.
- Utilizing Teleform for form creation and database definition, and a 'Mass Data Cleaning Program' (MDCP) with data dictionaries for error checking.
- Implementing iterative data correction processes, quality control (QC) checks, and quality assurance (QA) procedures.
Main Results:
- The MDM system demonstrated significant reductions in data processing time, with one-page forms taking 35-60% of the time required for manual entry.
- Automated scanning and dictionary checks identified and corrected errors, achieving low error rates (e.g., 0.02% after QC checks).
- The system processed data batches in 1 day, compared to over 1 week using manual methods, highlighting increased speed and cost-effectiveness.
Conclusions:
- The developed Mass Data Massage system offers a faster, more accurate, and cost-effective solution for data entry and management in large survey projects.
- Automated data handling significantly reduces systematic errors, enhancing overall data quality.
- The system's efficiency and accuracy make it a valuable tool for modern survey research.