Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Ordinal Level of Measurement00:55

Ordinal Level of Measurement

25.3K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
25.3K
Introduction to z Scores01:05

Introduction to z Scores

503
A z score (or standardized value) is measured in units of the standard deviation. It indicates how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
503
Ranks01:02

Ranks

273
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
273
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

274
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
274
Multiple Regression01:25

Multiple Regression

3.1K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.1K
Regression Analysis01:11

Regression Analysis

6.0K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
6.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A SEQUENTIAL SIGNIFICANCE TEST FOR TREATMENT BY COVARIATE INTERACTIONS.

Statistica Sinica·2026
Same author

RELEAP: reinforcement-enhanced label-efficient active phenotyping for electronic health records.

JAMIA open·2026
Same author

Feasibility of the "LvL UP" trial: a pilot sequential multiple assignment randomised trial of an adaptive, holistic mHealth lifestyle coaching intervention.

The international journal of behavioral nutrition and physical activity·2026
Same author

Enhancing Team Science by Training Collaborative Biostatisticians to have a Strong Statistical Voice.

Journal of statistical theory and practice·2025
Same author

A social determinants-based county-level cardiovascular mortality index to identify high-risk counties in the USA.

BMC medicine·2025
Same author

Developing federated time-to-event scores using heterogeneous real-world survival data.

Computers in biology and medicine·2025
Same journal

Methods for incorporating test result information within the high-dimensional propensity score framework: application in UK electronic health record data.

BMC medical research methodology·2026
Same journal

Sparse multi-way DMDC for longitudinal classification in high dimension low sample size data.

BMC medical research methodology·2026
Same journal

Tree-based exploratory identification of predictive biomarkers in non-randomized data.

BMC medical research methodology·2026
Same journal

Comparative evaluation of interrupted time series analytical methods for healthcare quality improvement research: a Monte Carlo simulation study.

BMC medical research methodology·2026
Same journal

Methodological advances in claims-based dementia algorithms: integrating medication and clinical data for medicare populations.

BMC medical research methodology·2026
Same journal

An interpretable XGboost algorithm for predicting 30-day mortality in acute pancreatitis using routine biomarkers.

BMC medical research methodology·2026
See all related articles

Related Experiment Video

Updated: Aug 23, 2025

Constructing and Visualizing Models using Mime-based Machine-learning Framework
06:19

Constructing and Visualizing Models using Mime-based Machine-learning Framework

Published on: July 22, 2025

270

AutoScore-Ordinal: an interpretable machine learning framework for generating scoring models for ordinal outcomes.

Seyed Ehsan Saffari1,2, Yilin Ning1, Feng Xie1,2

  • 1Centre for Quantitative Medicine, Duke-NUS Medical School, Singapore, Singapore.

BMC Medical Research Methodology
|November 5, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces an automated, interpretable machine learning framework designed to create risk prediction scores for health outcomes that have multiple ordered categories, such as patient status ranging from healthy to readmitted or deceased. By extending an existing binary outcome tool, this method allows clinicians to generate simple, point-based scores from complex electronic health records, facilitating better patient stratification and resource management.

Keywords:
Clinical scoreElectronic health recordsInterpretable machine learningMedical decision makingOrdinal outcomeClinical Decision SupportMachine LearningRisk StratificationElectronic Health Records

Frequently Asked Questions

More Related Videos

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K
Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research
04:54

Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research

Published on: November 8, 2024

616

Related Experiment Videos

Last Updated: Aug 23, 2025

Constructing and Visualizing Models using Mime-based Machine-learning Framework
06:19

Constructing and Visualizing Models using Mime-based Machine-learning Framework

Published on: July 22, 2025

270
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K
Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research
04:54

Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research

Published on: November 8, 2024

616

Area of Science:

  • Clinical informatics and AutoScore-Ordinal predictive analytics
  • Health services research and medical decision support systems

Background:

Clinical decision support systems frequently rely on risk stratification tools to optimize hospital resource allocation and improve patient care quality. Prior research has shown that automated machine learning methods can simplify the creation of predictive models for binary health outcomes. However, many clinical scenarios involve outcomes with multiple ordered categories rather than simple yes-or-no results. That uncertainty drove the need for more flexible modeling approaches capable of handling ordinal data structures. Existing frameworks often lack the interpretability required for widespread adoption in busy emergency department settings. No prior work had resolved how to maintain simplicity while capturing the complexity of ordered clinical states. This gap motivated the development of a systematic, automated approach for generating transparent scoring systems. The current study addresses this by adapting established algorithmic modules to accommodate ordinal variables.

Purpose Of The Study:

This study aims to expand the existing AutoScore framework to provide a tool for interpretable risk prediction regarding ordinal outcomes. The researchers sought to address the limitations of current binary-focused clinical scoring systems. They intended to create a method that maintains transparency while handling more complex, ordered health categories. The motivation stems from the need for automated tools that assist clinicians in effective risk stratification. By adapting the original six-module algorithm, the team aimed to streamline the development of point-based scoring models. They focused on ensuring that the resulting scores remain easy to interpret for medical decision-making. The project also sought to validate the framework using large-scale, real-world electronic health record data. This effort addresses the gap in providing scalable, automated solutions for multi-category outcome prediction in emergency medicine.

Main Methods:

The research team utilized a six-module algorithmic pipeline to build the predictive framework. They applied this methodology to a large longitudinal dataset spanning nine years of hospital admissions. The investigators partitioned the total patient population into training, validation, and testing subsets to ensure robust performance assessment. A flexible selection procedure identified the most relevant clinical features from the high-dimensional input data. The team derived point-based scores by applying proportional odds regression techniques to the selected variables. They performed model fine-tuning to optimize the balance between simplicity and predictive power. The evaluation phase involved calculating standard performance metrics to compare the new models against existing benchmarks. This review approach emphasizes the systematic nature of the automated generation process.

Main Results:

The primary models achieved a mean area under the receiver operating characteristic curve of 0.758 and 0.793. These results demonstrate strong predictive capability for the ordinal health outcomes examined. The generalized c-index values reached 0.737 and 0.760, confirming the reliability of the generated scores. The study analyzed 445,989 inpatient cases to validate the framework performance. The distribution of outcomes included 80.7% of patients alive without readmission, 12.5% alive with readmission, and 6.8% deceased. Two distinct point-based models were successfully developed using sets of eight predictor variables. These findings indicate that the automated approach performs comparably to alternative, less interpretable statistical methods. The data confirm that the framework effectively handles high-dimensional clinical information for risk stratification.

Conclusions:

The authors demonstrate that their framework successfully generates interpretable, point-based risk models for ordinal health outcomes. These models achieve performance metrics comparable to more complex, non-transparent alternative statistical methods. The approach allows for the systematic identification of predictive features within large, high-dimensional electronic health record datasets. Researchers suggest that this automated process reduces the burden of manual model development for clinical practitioners. The findings indicate that the framework maintains high predictive accuracy while ensuring ease of use in real-world settings. The study highlights the utility of proportional odds models within an automated pipeline for clinical score derivation. The authors propose that this tool facilitates consistent risk assessment across diverse patient populations. This work provides a scalable solution for integrating machine learning into routine clinical decision-making processes.

The framework utilizes six distinct modules: variable ranking, transformation, score derivation via proportional odds models, model selection, fine-tuning, and evaluation. This structured approach allows for the systematic conversion of high-dimensional electronic health record data into simple, point-based clinical scoring systems.

The researchers employ a flexible variable selection procedure to identify two sets of eight predictor variables. These specific features are then used to develop point-based models that categorize patient risk levels effectively.

Proportional odds models are necessary to handle the ordered nature of the outcomes, such as alive without readmission, alive with readmission, or death. This statistical choice ensures the framework can accurately predict outcomes with more than two ranked categories.

Electronic health records from the Singapore General Hospital emergency department serve as the primary data source. This large-scale dataset, containing 445,989 inpatient cases, enables the training, validation, and testing of the predictive models.

Performance is measured using the mean area under the receiver operating characteristic curve and the generalized c-index. The models achieved values of 0.758 and 0.793 for the former, and 0.737 and 0.760 for the latter.

The authors propose that this automated framework provides an easy-to-use solution for developing and validating risk prediction models. They claim it systematically identifies potential predictors, offering a practical alternative to more complex, less interpretable modeling techniques.