Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Incomplete data sets: coping with inadequate databases

R H Albert1, W Horwitz

  • 1U.S. Food and Drug Administration, Center for Food Safety and Applied Nutrition (HFS-500), Washington, DC 20204, USA.

Journal of AOAC International
|November 1, 1995
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Crystal structure of human type III 3alpha-hydroxysteroid dehydrogenase/bile acid binding protein complexed with NADP(+) and ursodeoxycholate.

Biochemistry·2001
Same author

Examination of proficiency and control recovery data from analyses for pesticide residues in food: sources of variability.

Journal of AOAC International·2001
Same author

Relationship of (known) control values to (unknown) test values in proficiency studies of pesticide residues.

Journal of AOAC International·2000
Same author

Laboratory proficiency testing of aflatoxins in corn and peanuts--a cooperative project between Thailand and the United States.

Journal of AOAC International·1999
Same author

A simple method for evaluating data from an interlaboratory study.

Journal of AOAC International·1998
Same author

Uncertainty--a chemist's view.

Journal of AOAC International·1998
Same journal

Single-Laboratory Validation of Simultaneous Determination of Aflatoxins in Nutraceuticals following immune-affinity Column Cleanup and Liquid Chromatography Tandem Mass Spectrometry Analysis.

Journal of AOAC International·2026
Same journal

Determination of Bromoform in Seaweed, Oil, and Animal Feed by GC-MS/MS: AOAC Official Method 2026.01, First Action.

Journal of AOAC International·2026
Same journal

ICRF-Assisted Box-Behnken Design and Optimization for Rapid UPLC-PDA Determination of Dorzolamide Hydrochloride and Timolol Maleate in an Ophthalmic Preparation.

Journal of AOAC International·2026
Same journal

Advancing PFAS Analysis Through Scientific Publication.

Journal of AOAC International·2026
Same journal

A Green UPLC-UV Method for L-Ascorbic Acid Determination Based on a Biodegradable Chelating Agent and Synergistic Hydrophobic-Electrostatic Interactions.

Journal of AOAC International·2026
Same journal

Quantification of 24 Inorganic Impurities in Vismodegib and Idelalisib Anti-Cancer Drug Substances by Using ICP-MS.

Journal of AOAC International·2026
See all related articles

This study addresses challenges with numerical database data, offering statistical methods to handle bad, missing, and sloppy data effectively. Solutions include robust statistics, interpolation, and nonparametric methods for improved data integrity.

Area of Science:

  • Data Science
  • Statistical Analysis
  • Database Management

Background:

  • Numerical databases frequently encounter issues like inaccurate entries, absent values, and imprecise measurements.
  • These data quality problems can significantly impact the reliability of analyses and conclusions drawn from databases.

Purpose of the Study:

  • To present statistical techniques for mitigating the adverse effects of bad, missing, and sloppy numerical data in databases.
  • To illustrate these methods using diverse real-world database examples.

Main Methods:

  • Bad data are managed using robust statistics and outlier removal techniques.
  • Missing data are addressed through interpolation or specialized statistics for unbalanced designs.
  • Sloppy, semiquantitative data are handled using nonparametric, rank, or attribute statistical methods.

Related Experiment Videos

Main Results:

  • Demonstrated the application of statistical methods to improve data quality in a telephone directory.
  • Showcased techniques for handling data in a carcinogenicity test results database.
  • Illustrated the use of methods for precision parameters derived from collaborative studies.

Conclusions:

  • Statistical approaches effectively mitigate issues arising from imperfect numerical data in databases.
  • The proposed methods enhance data reliability across various scientific and technical applications.
  • Effective data handling is crucial for accurate interpretation of database information.