Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Experimental Designs01:16

Experimental Designs

An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Group Design02:01

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Methods of Medium Optimization01:28

Methods of Medium Optimization

Optimizing growth media enhances microbial proliferation and maximizes product yield. Statistical experimental design methodologies provide structured and reproducible approaches, offering progressively higher levels of robustness and efficiency.The One-Factor-at-a-Time (OFAT) MethodThe One-Factor-at-a-Time (OFAT) method involves adjusting a single variable while keeping all others constant. However, it cannot detect interactions between variables, often leading to suboptimal outcomes when...
The Anchoring-and-Adjustment Heuristic01:25

The Anchoring-and-Adjustment Heuristic

In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Ag-Substituted Nanocrystal Building Blocks for Enhanced Thermoelectric Performance in Earth-Abundant Cu<sub>12</sub>Sb<sub>4</sub>S<sub>13</sub> Tetrahedrite.

ACS applied materials & interfaces·2026
Same author

Metal oxide hollow heterojunctions derived from bimetal-organic frameworks for efficient urea photosynthesis.

Dalton transactions (Cambridge, England : 2003)·2026
Same author

Antibacterial, In Vitro Anti-Inflammatory and Anti-Acne Activities of <i>Patchouli</i> Essential Oil.

Pharmaceuticals (Basel, Switzerland)·2026
Same author

A bibliometric analysis of neuroimaging studies on cognitive control in autism spectrum disorder (2000-2025).

Frontiers in psychiatry·2026
Same author

Non-linear relationship between triglyceride glucose-body mass index and risk of diabetes in adults: a general population-based cohort study of Chinese adults using a publicly available DRYAD dataset.

Frontiers in endocrinology·2026
Same author

From categorization to quantification: Stage-dependent neural and behavioral mechanisms of facial emotion recognition.

NeuroImage·2026

Related Experiment Video

Updated: May 9, 2026

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
20:24

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

Upfront design beats post hoc reliability fixes.

Junhua Dang1, Shanshan Xiao2

  • 1School of Humanities and Social Sciences, Xi'an Jiaotong University, Xi'an, China.

Trends in Cognitive Sciences
|May 7, 2026
PubMed
Summary
This summary is machine-generated.

Behavioral tasks struggle with reliable individual measurements. Improving reliability requires increasing trials per person and enhancing per-trial informativeness, crucial for translational research.

Keywords:
reliability paradoxtask calibrationwithin-person sampling

More Related Videos

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Related Experiment Videos

Last Updated: May 9, 2026

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
20:24

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Area of Science:

  • Cognitive psychology
  • Neuroscience
  • Psychometrics

Background:

  • Behavioral tasks frequently demonstrate significant group-level effects.
  • However, these tasks often yield unreliable estimates at the individual level.
  • Existing methods to enhance reliability show limited success.

Purpose of the Study:

  • To identify the key factors influencing person-level reliability in behavioral tasks.
  • To advocate for a focused approach on measurement engineering for improved translational research.

Main Methods:

  • The study reviews existing literature on reliability in behavioral measurements.
  • It emphasizes the two primary determinants of person-level reliability: number of trials per person and informativeness of each trial.
  • The analysis supports a 'two-lever' model for reliability enhancement.

Main Results:

  • Person-level reliability is primarily determined by the number of trials and the informativeness of each trial.
  • Many proposed 'reliability fixes' are ineffective because they do not address these core determinants.
  • Evidence supports the 'two-lever' view of reliability.

Conclusions:

  • Routine reliability auditing and measurement engineering are essential for advancing translational research.
  • Focusing on increasing trials per person and per-trial informativeness is key to improving individual measurement reliability.
  • This approach offers a more effective strategy than general 'reliability fixes'.