Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Response Surface Methodology

Response Surface Methodology

Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:

Robbers Cave

Robbers Cave

During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...

Randomized Experiments

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...

Margin of Error

Margin of Error

The margin of error is also called the maximum error of an estimate. The margin of error is the maximum possible or expected difference between the observed sample parameter value and the actual population parameter value. For proportion, it is the maximum difference between the value of sample proportion obtained from the data and the true value of population proportion. As the true value of the population parameter is not known, the margin of error is calculated using the sample statistic.

Friedman Two-way Analysis of Variance by Ranks

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...

Ranks

Ranks

Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The Science of Gun Policy: A Critical Synthesis of Research Evidence on the Effects of Gun Policies in the United States, Fifth Edition.

Rand health quarterly·2026

Same author

Generics in Medicaid increased in price and shifted to larger manufacturers amid 2022-2023 amphetamine shortage.

Health affairs scholar·2026

Same author

Barriers and Facilitators to Interest-Holder Engagement in Health Guideline Development: A Qualitative Evidence Synthesis.

Campbell systematic reviews·2026

Same author

State Laws Restricting Concealed Handguns in Sensitive Places: 2024 Landscape.

American journal of preventive medicine·2026

Same author

Disparities in the prevalence and reporting of civilian justifiable firearm homicide.

Injury epidemiology·2026

Same author

Racial and ethnic disparities in fatal police shootings: Variation across U.S. states and the role of firearm ownership.

PloS one·2026

Search research articles

Related Experiment Video

Updated: Jun 25, 2025

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Published on: May 10, 2019

ROMPER: The RAND/USC OPTIC Method for Policy Expert Ratings.

Sean Grant^1,2, Rosanna Smart¹

¹RAND Corporation, 1776 Main St, Santa Monica, CA 90401, USA.

|May 27, 2024

Summary

We created a new method, ROMPER, to gather expert opinions on population-level policy effectiveness and implementability. This validated, open-access approach aids policymakers in understanding expert consensus on interventions.

Keywords:

Consensus Delphi Expert panel GRADE ROMPER: The RAND/USC OPTIC Method for Policy Expert Ratings

More Related Videos

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Published on: September 19, 2012

Continuous Theta Burst Stimulation of the Posterior Medial Frontal Cortex to Experimentally Reduce Ideological Threat Responses

Continuous Theta Burst Stimulation of the Posterior Medial Frontal Cortex to Experimentally Reduce Ideological Threat Responses

Published on: September 28, 2018

Related Experiment Videos

Last Updated: Jun 25, 2025

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Published on: May 10, 2019

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Published on: September 19, 2012

Continuous Theta Burst Stimulation of the Posterior Medial Frontal Cortex to Experimentally Reduce Ideological Threat Responses

Continuous Theta Burst Stimulation of the Posterior Medial Frontal Cortex to Experimentally Reduce Ideological Threat Responses

Published on: September 28, 2018

Area of Science:

Health policy research
Decision science
Qualitative and quantitative research synthesis

Background:

Assessing population-level policy interventions requires understanding expert perspectives on effectiveness and implementability.
Existing methods may not adequately capture nuanced expert consensus or provide actionable summaries for policymakers.

Purpose of the Study:

To introduce and validate ROMPER (RAND/USC OPTIC Method for Policy Expert Ratings), an expert panel approach for evaluating policy interventions.
To provide a structured, replicable, and open-access method for eliciting and synthesizing expert views on policy effectiveness and implementability.

Main Methods:

A three-round, modified-Delphi process where experts rate policies using the GRADE Evidence-to-Decision framework.
Quantitative analysis of expert ratings using IPRAS and qualitative analysis of comments via reflexive thematic analysis.
Summarization of findings into "Policy Profiles" for decision-makers, adapted from GRADEPro Evidence-to-Decision tables.

Main Results:

ROMPER successfully recruited target sample sizes and retained experts across all three rounds in validation studies.
The method effectively identified consensus on policy effectiveness and implementability.
Protocols, materials, data, and code are openly available on the Open Science Framework.

Conclusions:

ROMPER offers a validated, replicable, and open-access approach for expert elicitation on policy effectiveness and implementability.
The method facilitates the summarization of expert consensus, providing valuable insights for policymakers.
Open availability promotes transparency and reuse in policy research.