Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Test for Homogeneity

Test for Homogeneity

The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can be stated as...

Errors In Hypothesis Tests

Errors In Hypothesis Tests

When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.

Randomized Experiments

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...

Significance Testing: Overview

Significance Testing: Overview

Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...

Statistical Hypothesis Testing

Statistical Hypothesis Testing

Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with data...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Effect of computer support on younger women with breast cancer.

Journal of general internal medicine·2001

Same author

Patient education in pain control.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2001

Same author

The consequence of ignoring a nested factor on measures of effect size in analysis of variance.

Psychological methods·2001

Same author

Answering two criticisms of hypothesis testing: a comment.

Psychological reports·2000

Same author

A computer-administered telephone interview to identify mental disorders.

JAMA·1997

Same author

Dimensions of the impact of cancer pain in a four country sample: new information from multidimensional scaling.

Pain·1996

Search research articles

Related Experiment Video

Updated: Jul 22, 2026

Barnes Maze Testing Strategies with Small and Large Rodent Models

Barnes Maze Testing Strategies with Small and Large Rodent Models

Published on: February 26, 2014

Testing for robustness in Monte Carlo studies.

¹Department of Educational Psychology, University of Wisconsin-Madison 53706, USA. rcserlin@facstaff.wisc.edu

Psychological Methods

|August 11, 2000

Summary

Monte Carlo studies help select statistical procedures when assumptions are unmet. This research clarifies Type I error control and sample size determination for robust analysis, improving reliability in simulations.

Area of Science:

Statistics
Computational Science
Data Analysis

Background:

Monte Carlo studies are crucial for evaluating statistical procedures, especially when assumptions are violated.
Previous applications of statistical design principles to Monte Carlo studies have misidentified Type I errors.
Accurate error assessment is vital for determining the robustness of analytical methods.

Purpose of the Study:

To present a method for controlling the correct Type I error rate in Monte Carlo studies.
To describe how to determine the necessary number of iterations for desired statistical power.
To derive a confidence interval for the true Type I error rate of a test.

Main Methods:

Development of a novel approach for Type I error rate control in simulations.

More Related Videos

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Related Experiment Videos

Last Updated: Jul 22, 2026

Barnes Maze Testing Strategies with Small and Large Rodent Models

Barnes Maze Testing Strategies with Small and Large Rodent Models

Published on: February 26, 2014

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Formulation of a procedure for calculating the required sample size (number of iterations) to achieve specific power.

Derivation of a confidence interval for estimating the true Type I error rate.

Proposal of a new robustness criterion balancing existing standards.

Main Results:

A method is established for accurately controlling the Type I error rate in Monte Carlo simulations.
Guidelines are provided for determining the optimal number of iterations for achieving desired statistical power.
A confidence interval for the true Type I error rate has been derived, enhancing estimation accuracy.
A new, balanced criterion for assessing statistical robustness is introduced.

Conclusions:

The presented methods enhance the rigor and reliability of Monte Carlo studies.
Researchers can now more accurately assess statistical procedure robustness and determine appropriate simulation parameters.
This work provides a framework for more informed decision-making in selecting analytical procedures under non-ideal conditions.