Jove
Visualize
Contact Us

Related Concept Videos

Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

4.4K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.4K
Sample Size Calculation01:19

Sample Size Calculation

6.9K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
6.9K
Data: Types and Distribution01:19

Data: Types and Distribution

2.1K
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
2.1K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

7.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
7.2K
Data Validation01:03

Data Validation

7.2K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
7.2K
Data Validation01:15

Data Validation

3.4K
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
3.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Digitization and Linkage of PDF Formatted 12-Lead Electrocardiograms in Adult Congenital Heart Disease.

CJC pediatric and congenital heart disease·2026
Same author

An arithmetic method algorithm optimizing k-nearest neighbors compared to regression algorithms and evaluated on real world data sources.

Scientific reports·2026
Same author

Decentralized Personalized Federated Learning Based on a Conditional "Sparse-to-Sparser" Scheme.

IEEE transactions on neural networks and learning systems·2025
Same author

Phospholipid production and signaling by a plant defense inducer against <i>Podosphaera xanthii</i> is genotype-dependent.

Horticulture research·2024
Same author

Priorities and Challenges in Methodology for Human Health Risk Assessment from Combined Exposure to Multiple Chemicals.

Toxics·2023
Same author

History, Variations, and Extensions of the Retrosigmoid Approach: Anatomical and Literature Review.

Journal of neurological surgery. Part B, Skull base·2022
Same journal

Constructing an Artificial Intelligence-Driven Multilingual Medical Health Education Chatbot with Domain-Specific Medical Knowledge.

Big data·2026
Same journal

Explainable Machine Learning-Based Prediction of Postoperative Hypoxemia in Elderly Patients Undergoing General Anesthesia.

Big data·2026
Same journal

Big Data-Driven Video Anomaly Detection Using VideoMAE for Visual Analytics in CCTV Surveillance.

Big data·2026
Same journal

Agentic Artificial Intelligence-Driven Explainable Deep Learning for Deciphering Noncoding Pathogenic Mechanisms of Delirium Through Genomic Big Data Integration.

Big data·2026
Same journal

Personalized Driven Instruction Through Explainable Agentic AI in Multicultural Higher Education Environments.

Big data·2026
Same journal

Big Data-Driven Explainable Agentic AI Decision Frameworks for Enterprise Innovation in FinTech Ecosystems.

Big data·2026
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Mar 17, 2026

Databases to Efficiently Manage Medium Sized, Low Velocity, Multidimensional Data in Tissue Engineering
09:43

Databases to Efficiently Manage Medium Sized, Low Velocity, Multidimensional Data in Tissue Engineering

Published on: November 22, 2019

6.9K

Scalable Data Quality for Big Data: The Pythia Framework for Handling Missing Values.

Atoshum Cahsai1, Christos Anagnostopoulos1, Peter Triantafillou1

  • 1School of Computing Science, University of Glasgow , Glasgow, United Kingdom .

Big Data
|July 22, 2016
PubMed
Summary
This summary is machine-generated.

The Pythia framework efficiently handles missing values in large datasets by using distributed data nodes. It offers improved efficiency, scalability, and accuracy compared to traditional single-machine methods.

Keywords:
adaptive resonance theoryadaptive vector quantizationbig dataimputationmissing valuesscalabilityself-organizing maps

More Related Videos

A User-friendly and Powerful R Analysis of Large-scale Datasets
10:56

A User-friendly and Powerful R Analysis of Large-scale Datasets

Published on: November 4, 2025

440

Related Experiment Videos

Last Updated: Mar 17, 2026

Databases to Efficiently Manage Medium Sized, Low Velocity, Multidimensional Data in Tissue Engineering
09:43

Databases to Efficiently Manage Medium Sized, Low Velocity, Multidimensional Data in Tissue Engineering

Published on: November 22, 2019

6.9K
A User-friendly and Powerful R Analysis of Large-scale Datasets
10:56

A User-friendly and Powerful R Analysis of Large-scale Datasets

Published on: November 4, 2025

440

Area of Science:

  • Data Science
  • Machine Learning
  • Computational Statistics

Background:

  • Missing value (MV) imputation in large-scale datasets is computationally intensive, hindering scalability.
  • Existing MV imputation methods are often dependent on dataset volume and dimensionality.
  • Growing datasets exacerbate the computational challenges of MV imputation.

Purpose of the Study:

  • To investigate the robustness and independence of the Pythia framework from specific imputation algorithms and signature construction methods.
  • To evaluate the efficiency, scalability, and accuracy of Pythia against a single-machine approach (Godzilla).

Main Methods:

  • Pythia framework utilizing distributed data nodes (cohorts) and parallel processing.
  • Selection of relevant cohorts based on machine and statistical learning signatures.
  • Implementation and testing with K-nearest neighbor and expectation-maximization MVAs, and adaptive vector quantization/competitive learning signatures.

Main Results:

  • Pythia demonstrates robustness and independence from specific MV imputation algorithms and signature construction techniques.
  • Pythia achieves superior efficiency, scalability, and accuracy compared to the Godzilla single-machine approach.
  • Experimental results validate the benefits of the distributed Pythia framework for large-scale MV imputation.

Conclusions:

  • The Pythia framework provides a scalable and efficient solution for missing value imputation in large datasets.
  • Pythia's design ensures flexibility, allowing integration with various imputation algorithms and signature construction methods.
  • This distributed approach significantly outperforms traditional single-machine methods in terms of performance and resource utilization.