Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Experimental Designs01:16

Experimental Designs

An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Surveys02:16

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and case-control studies.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Evaluating the implementation of Electronic Palliative Care Co-ordination Systems (EPaCCS) and optimising future service provision for palliative and end-of-life care: a synopsis of the Optimal Care mixed-method study.

Health and social care delivery research·2026
Same author

Access to Care and Patient Safety Measures: Placement in Healthcare Quality Frameworks, Degree to Which They Meet Criteria Used to Select and/or Prioritize Quality Measures, and Mapping to the National Quality Strategy levers.

American journal of medical quality : the official journal of the American College of Medical Quality·2026
Same author

Integrating health economics and implementation science: a call to action.

BMC medical research methodology·2026
Same author

Optimising a behavioural intervention to support endocrine therapy adherence for women with breast cancer: protocol for the ROSETA optimisation factorial randomised controlled trial.

Trials·2026
Same author

Survey on perioperative tranexamic acid use.

British journal of haematology·2026
Same author

Transitions of care following acute kidney injury: a systems-based analysis.

BMC nephrology·2026

Related Experiment Video

Updated: May 26, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Conducting online expert panels: a feasibility and experimental replicability study.

Dmitry Khodyakov1, Susanne Hempel, Lisa Rubenstein

  • 1The RAND Corporation, 1776 Main Street, PO Box 2138, Santa Monica, CA 90401, USA. Dmitry_Khodyakov@rand.org

BMC Medical Research Methodology
|December 27, 2011
PubMed
Summary

Online expert panels are feasible for consensus finding among distributed stakeholders. This method allows for testing the replicability of findings across multiple panels of varying sizes.

More Related Videos

Interactive and Visualized Online Experimentation System for Engineering Education and Research
08:35

Interactive and Visualized Online Experimentation System for Engineering Education and Research

Published on: November 24, 2021

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters
07:29

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters

Published on: November 22, 2019

Related Experiment Videos

Last Updated: May 26, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Interactive and Visualized Online Experimentation System for Engineering Education and Research
08:35

Interactive and Visualized Online Experimentation System for Engineering Education and Research

Published on: November 24, 2021

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters
07:29

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters

Published on: November 22, 2019

Area of Science:

  • Health services research
  • Online consensus building
  • Expert panel methodology

Background:

  • Exploring the feasibility of online expert panels for consensus finding.
  • Assessing the replicability of panel findings across different panel sizes.

Purpose of the Study:

  • To determine if online expert panels can effectively achieve consensus among geographically dispersed stakeholders.
  • To evaluate the consistency of results when using multiple, parallel online panels of varying sizes.

Main Methods:

  • 119 panelists engaged in an iterative process to define Continuous Quality Improvement (CQI) features.
  • Four parallel online panels used the RAND's ExpertLens process over three phases: rating, online discussion, and re-rating.
  • Utilized asynchronous, anonymous online discussion boards for expert deliberation.

Main Results:

  • Panel disagreement decreased after online discussion for 36 out of 43 CQI features.
  • Fair agreement (four-way kappa=0.36) was achieved across four panels on five of eleven CQI features.
  • Participants were generally satisfied with the online process; larger panels fostered more perceived debate.

Conclusions:

  • Online expert panels are a feasible method for consensus building among distributed stakeholders.
  • This approach is practical for engaging diverse groups in health services research.
  • Multiple parallel online panels can be used to test the reproducibility of consensus findings.