Related Experiment Video
Updated: Jul 27, 2026

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
Published on: January 31, 2014
Using Error/Tolerance Analysis to Design an Empirical Practice Analysis
1Department of Kinesiology, University of Wisconsin-Madison, Madison, WI 53706, USA.
Abstract:
Practice analyses, in which professional practitioners describe their work, provide essential content-related validity evidence for licensure and certification tests by providing an empirical base for the test plan. This paper examines the precision of the category weights generated by practice analyses employing activity inventories. The standard errors in estimates of category weights are compared to the tolerance for error in these weights. The tolerance for error specifies how large errors can be before they interfere with the intended use of the measurement procedure. As an example, data from a practice-analysis study is used to assign weights to nine categories in a test plan. Estimates of standard errors are derived from G studies with activity statements nested within categories and crossed with respondents and occasions. The tolerance for error is specified in terms of the level of precision typically found in test plans. The results are used to determine the minimum number of activities needed for each category to satisfy the tolerance requirement.
Related Concept Videos
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Types of Errors: Detection and Minimization
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Detection of Gross Error: The Q Test
Contaminants and Errors
Another key consideration is determining the appropriate number of samples required to...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...

