Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

4.0K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.0K
Strategies for Assessing and Addressing Confounding01:25

Strategies for Assessing and Addressing Confounding

596
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
596
Genome-wide Association Studies-GWAS01:11

Genome-wide Association Studies-GWAS

12.6K
Genome-wide association studies or GWAS are used to identify whether common SNPs are associated with certain diseases. Suppose specific SNPs are more frequently observed in individuals with a particular disease than those without the disease. In that case, those SNPs are said to be associated with the disease. Chi-square analysis is performed to check the probability of the allele likely to be associated with the disease.
GWAS does not require the identification of the target gene involved in...
12.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same journal

Optimizing vaccine site locations while considering travel inconvenience and public health outcomes.

Health care management scienceยท2026
Same journal

An online algorithm for integrated scheduling of pre-treatment and treatment appointments in radiotherapy using deep reinforcement learning.

Health care management scienceยท2026
Same journal

Optimal hospital capacity management during demand surges.

Health care management scienceยท2026
Same journal

Towards optimal valve prescription for transcatheter aortic valve replacement (TAVR) surgery: a machine learning approach.

Health care management scienceยท2026
Same journal

Efficient engagement: opportunities for mobile methadone maintenance in geographically underserved areas.

Health care management scienceยท2026
Same journal

Ahead of the ambulance: Optimizing volunteer training.

Health care management scienceยท2026

Related Experiment Video

Updated: Apr 30, 2026

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.0K

A machine learning approach to create blocking criteria for record linkage.

Phan H Giang1

  • 1George Mason University Fairfax, 4400 University Dr. Fairfax, Fairfax, VA, 22030, USA, pgiang@gmu.edu.

Health Care Management Science
|April 30, 2014
PubMed
Summary

This study introduces an automated method for learning efficient blocking criteria in record linkage (RL), significantly reducing data processing time. The approach generates unlimited labeled data, improving efficiency compared to manual methods.

More Related Videos

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.0K

Related Experiment Videos

Last Updated: Apr 30, 2026

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.0K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.0K

Area of Science:

  • Data Science
  • Computer Science
  • Database Management

Background:

  • Record linkage (RL) is a critical but computationally expensive step in data warehousing.
  • Traditional RL systems rely on manual selection of blocking criteria, which is time-consuming and requires domain expertise.

Purpose of the Study:

  • To propose a novel method for automatically learning efficient blocking criteria for record linkage.
  • To address the challenge of insufficient labeled data in training RL systems.

Main Methods:

  • Developed a method to learn blocking filters in conjunction with a matcher, leveraging matcher-assigned labels for data generation.
  • Formulated the blocking filter learning as a Disjunctive Normal Form (DNF) problem.
  • Utilized Probably Approximately Correct (PAC) learning theory to guide the search algorithm.

Main Results:

  • The learned blocking filters achieved comparable recall to manually selected filters.
  • The automated method reduced runtime by an order of magnitude compared to educated guesses.
  • Successfully tested on a large-scale patient master file (2.18 million records).

Conclusions:

  • Automated learning of blocking criteria is feasible and highly efficient for record linkage.
  • The proposed method effectively overcomes the limitation of insufficient labeled data.
  • This approach offers significant performance improvements in data warehousing and cleaning.