Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Decision Making: P-value Method01:09

Decision Making: P-value Method

6.8K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
6.8K
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

5.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.1K
Decision Making01:20

Decision Making

879
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
879
Strategies for Assessing and Addressing Confounding01:25

Strategies for Assessing and Addressing Confounding

356
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
356
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

447
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
447
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

1.2K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
1.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Drug-Conjugated Tam-NHC-Gold(I) Complexes Overcome <i>ESR1</i> Mutant Breast Cancer Resistance and Downregulate the RAMP3/CALCR Signaling Pathway.

Journal of medicinal chemistry·2026
Same author

High glucose impairs cognitive function by inducing lipid droplet accumulation through lactylation of HSD17B10 at K105.

Cell reports·2026
Same author

Ultrasonic treatment effects on hydroxyl radical generation in various solution systems: an iodometric analysis.

Ultrasonics sonochemistry·2026
Same author

Natural monomer compounds in neurodegenerative diseases: Targeting ferroptosis and neuroinflammation.

Behavioural brain research·2026
Same author

Solvent-Modulated Orthogonal Release from Covalent Organic Frameworks Enables Sequential Multiomics Enrichment.

Journal of the American Chemical Society·2026
Same author

Leveraging computerized adaptive testing for cost-effective evaluation of large language models in medical benchmarking.

NPJ digital medicine·2026

Related Experiment Video

Updated: Jan 13, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.9K

Empowering Expert Judgment: A Data-Driven Decision Framework for Standard Setting in High-Dimensional and Data-Scarce

Tianpeng Zheng1,2, Zhehan Jiang2,3, Zhichen Guo2

  • 1School of Public Health, Peking University, Beijing, China.

Educational and Psychological Measurement
|January 6, 2026
PubMed
Summary

Standard setting in challenging small-sample, high-dimensional data requires advanced methods. Information-theoretic and clustering approaches offer solutions, with optimal choice depending on examinee proficiency distribution.

Keywords:
clusteringcut scoreinformation theorysmall sample sizestandard setting

More Related Videos

Watershed Planning within a Quantitative Scenario Analysis Framework
12:44

Watershed Planning within a Quantitative Scenario Analysis Framework

Published on: July 24, 2016

8.4K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.9K

Related Experiment Videos

Last Updated: Jan 13, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.9K
Watershed Planning within a Quantitative Scenario Analysis Framework
12:44

Watershed Planning within a Quantitative Scenario Analysis Framework

Published on: July 24, 2016

8.4K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.9K

Area of Science:

  • Psychometrics
  • Statistical modeling
  • Educational measurement

Background:

  • Standard setting faces challenges in small-sample, high-dimensional data where item count exceeds examinee count.
  • Traditional parametric models like item response theory can be unstable or fail due to unreliable parameter estimation in these contexts.

Purpose of the Study:

  • To investigate and evaluate information-theoretic and unsupervised clustering methods for standard setting in challenging data conditions.
  • To establish an evidence-based framework for selecting appropriate data-driven standard-setting methods.

Main Methods:

  • A Monte Carlo simulation was employed to systematically evaluate 15 data-driven methods.
  • Simulation factors included sample size, item-to-examinee ratio, mixture proportions, item quality, and ability separation.
  • Performance was assessed using Relative Error, Classification Accuracy, Sensitivity, Specificity, and Youden's Index.

Main Results:

  • No single method proved universally superior; optimal method selection is contingent on examinee mixture proportions.
  • The quantile information ratio (QIR) method showed high specificity in scenarios with a dominant non-competent group.
  • Clustering methods like Calinski-Harabasz index (CHI) and sum of squared error (SSE) were effective in selective contexts with balanced groups.
  • Bayesian kernel density estimation (BKDE) demonstrated robust and balanced performance across various conditions.

Conclusions:

  • The study provides a decision framework for practitioners to select defensible, data-driven standard-setting methods when traditional approaches are infeasible.
  • The findings highlight the importance of considering examinee characteristics and data structure when choosing a standard-setting methodology.