Related Experiment Video

Updated: May 1, 2026

Generation and Multi-phenotypic High-content Screening of Coxiella burnetii Transposon Mutants

Generation and Multi-phenotypic High-content Screening of Coxiella burnetii Transposon Mutants

Published on: May 13, 2015

CohortDiagnostics: Phenotype evaluation across a network of observational data sources using population-level

Gowtham A Rao^1,2, Azza Shoaibi^1,2, Rupa Makadia^1,2

¹Observational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.

|January 17, 2025

Abstract

Objective:

This paper introduces a novel framework for evaluating phenotype algorithms (PAs) using the open-source tool, Cohort Diagnostics.

Materials And Methods:

The method is based on several diagnostic criteria to evaluate a patient cohort returned by a PA. Diagnostics include estimates of incidence rate, index date entry code breakdown, and prevalence of all observed clinical events prior to, on, and after index date. We test our framework by evaluating one PA for systemic lupus erythematosus (SLE) and two PAs for Alzheimer's disease (AD) across 10 different observational data sources.

Results:

By utilizing CohortDiagnostics, we found that the population-level characteristics of individuals in the cohort of SLE closely matched the disease's anticipated clinical profile. Specifically, the incidence rate of SLE was consistently higher in occurrence among females. Moreover, expected clinical events like laboratory tests, treatments, and repeated diagnoses were also observed. For AD, although one PA identified considerably fewer patients, absence of notable differences in clinical characteristics between the two cohorts suggested similar specificity.

Discussion:

We provide a practical and data-driven approach to evaluate PAs, using two clinical diseases as examples, across a network of OMOP data sources. Cohort Diagnostics can ensure the subjects identified by a specific PA align with those intended for inclusion in a research study.

Conclusion:

Diagnostics based on large-scale population-level characterization can offer insights into the misclassification errors of PAs.

More Related Videos

Candidate Gene Testing in Clinical Cohort Studies with Multiplexed Genotyping and Mass Spectrometry

Candidate Gene Testing in Clinical Cohort Studies with Multiplexed Genotyping and Mass Spectrometry

Published on: June 21, 2018

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Published on: December 7, 2021

Related Concept Videos

Ordinal Level of Measurement

Ordinal Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...

How Data are Classified: Categorical Data

How Data are Classified: Categorical Data

A variable, usually notated by capital letters such as X and Y, is a characteristic or measurement that can be determined for each member of a population. Data are the actual values of variables. They may be numbers, or they may be words. Datum is a single value.
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...

Data Collection by Observations

Data Collection by Observations

Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...

Analysis of Population Pharmacokinetic Data

Analysis of Population Pharmacokinetic Data

Analysis of population pharmacokinetic data involves studying the behavior of drugs within diverse populations to understand their pharmacokinetic parameters. Traditional pharmacokinetic methods typically involve collecting samples from a few individuals and estimating these parameters. While these methods are commonly used, they have limitations in capturing the variability in drug response among individuals or heterogeneous populations. Population pharmacokinetics is employed to address these...

Statistical Methods for Analyzing Epidemiological Data

Statistical Methods for Analyzing Epidemiological Data

Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:

Methods to Assess Microbial Populations

Methods to Assess Microbial Populations

Assessing microbial populations is crucial for understanding microbial roles in health, ecology, and industry. Various complementary techniques—both culture-based and molecular—enable detailed analysis of microbial abundance, diversity, and function.Viable Plate CountThe viable plate count is a traditional culture-based method used to estimate the number of living microbes in a sample. After serial dilution, the sample is spread onto nutrient agar plates. Each viable cell forms a...

Articles linked to this work by shared authors, journal, and citation graph.

REWARD-an open-source framework for identifying the unknown benefits of existing medications to inform drug discovery, development, and repurposing.

Journal of the American Medical Informatics Association : JAMIA·2026

Evaluating large-scale propensity score adjustment when sample size is small.

Journal of the American Medical Informatics Association : JAMIA·2026

Distributional Diagnosis and Calibration with Negative Controls for Outcome-wide Real-world Evidence.

medRxiv : the preprint server for health sciences·2026

Active Safety Surveillance Using Real-World Evidence (ASSURE) Implementation: Transparent and Reproducible Real-World Evidence Standardized Framework to Support Safety Signal Evaluation.

Pharmacoepidemiology and drug safety·2026

PDA (Privacy-Preserving Distributed Algorithms) in action: ten principles for high-quality multi-site clinical evidence generation.

Journal of the American Medical Informatics Association : JAMIA·2026

Real-world performance of large-scale propensity score adjustment strategies: Matching, weighting, and stratification.

Research square·2026

See all related articles