Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Tumor Progression02:07

Tumor Progression

8.0K
Tumor progression is a phenomenon where the pre-formed tumor acquires successive mutations to become clinically more aggressive and malignant. In the 1950s, Foulds first described the stepwise progression of cancer cells through successive stages.
Colon cancer is one of the best-documented examples of tumor progression. Early mutation in the APC gene in colon cells causes a small growth on the colon wall called a polyp. With time, this polyp grows into a benign, pre-cancerous tumor. Further...
8.0K
Tumor Progression02:07

Tumor Progression

3.6K
3.6K
Wald-Wolfowitz Runs Test II01:17

Wald-Wolfowitz Runs Test II

656
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
656
Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

4.2K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
4.2K
Complementation Tests00:49

Complementation Tests

6.6K
A complementation test is a simple cross to identify whether the two mutations are located on the same gene or different genes. It was first performed by Edward Lewis in the 1940s while working on fruit flies. He developed the test to identify the location and arrangement of different mutations on chromosomes.
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
6.6K
Flow Table Test01:12

Flow Table Test

1.0K
The flow table test is an established method used to assess the workability of concrete, particularly useful for evaluating highly flowable concrete mixes. This test employs an apparatus that consists of a wooden board topped with a steel plate, collectively weighing 35 pounds. The board is connected to a base via a hinge and measures 27.6 inches on each side.
Concrete is placed within a truncated cone mold that is 8 inches high with an 8-inch base diameter and a 5-inch top diameter. The...
1.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Authors reply: "AI in critical care: a roadmap to the future".

Journal of critical care·2026
Same author

Comparison of [<sup>18</sup>F]DPA-814 with [<sup>18</sup>F]DPA-714 for TSPO Imaging in an Experimental Model.

Molecular imaging and biology·2026
Same author

Comparative Study of [<sup>18</sup>F]DPA714 and [<sup>18</sup>F]FDG PET Tracers in an Experimental Model of Pulmonary Tuberculosis.

Molecular imaging and biology·2025
Same author

AI in critical care: A roadmap to the future.

Journal of critical care·2025
Same author

Bilateral caudate nucleus infarction associated with variant in circle of Willis.

BMJ case reports·2025
Same author

Evolving health professions educators' work engagement in teaching while combining roles in an academic medical center.

BMC medical education·2025

Related Experiment Video

Updated: Apr 14, 2026

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.4K

The don't know option in progress testing.

C J Ravesloot1, M F Van der Schaaf2, A M M Muijtjens3

  • 1Radiology Department, University Medical Center Utrecht, Heidelberglaan 100, Room E01.132, 3508 GA, Utrecht, The Netherlands. C.J.Ravesloot@umcutrecht.nl.

Advances in Health Sciences Education : Theory and Practice
|April 28, 2015
PubMed
Summary

Formula scoring (FS) with a don't know option (DKO) may introduce irrelevant variance into knowledge tests. However, FS significantly improves score reliability compared to number-right scoring, suggesting a trade-off in test development.

Keywords:
Construct validityConstruct-irrelevant varianceDon’t know optionFormula scoringProgress testingReliabilityRisk-taking tendency

More Related Videos

Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

19.5K
Development and Implementation of a Multi-Disciplinary Technology Enhanced Care Pathway for Youth and Adults with Concussion
08:13

Development and Implementation of a Multi-Disciplinary Technology Enhanced Care Pathway for Youth and Adults with Concussion

Published on: January 20, 2019

7.2K

Related Experiment Videos

Last Updated: Apr 14, 2026

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.4K
Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

19.5K
Development and Implementation of a Multi-Disciplinary Technology Enhanced Care Pathway for Youth and Adults with Concussion
08:13

Development and Implementation of a Multi-Disciplinary Technology Enhanced Care Pathway for Youth and Adults with Concussion

Published on: January 20, 2019

7.2K

Area of Science:

  • Medical Education
  • Psychometrics
  • Assessment

Background:

  • Formula scoring (FS), which includes a don't know option (DKO) and penalizes incorrect answers, is debated for its impact on the validity and reliability of educational assessments.
  • The DKO choice can be influenced by factors beyond knowledge, such as risk-taking tendencies, potentially introducing construct-irrelevant variance.

Purpose of the Study:

  • To evaluate the effect of FS on the construct validity and reliability of radiology resident progress test scores.
  • To determine if FS introduces construct-irrelevant variance into knowledge measurement.

Main Methods:

  • A radiology resident progress test was administered in parallel forms (A and B) with both FS and number-right (NR) scoring versions.
  • 337 participants were randomly assigned to receive either A-FS followed by B-NR or B-FS followed by A-NR.
  • Hierarchical regression analysis and Cronbach's alpha were used to assess construct validity and score reliability.

Main Results:

  • FS introduced construct-irrelevant variance, as DKO and its interaction with gender explained 8% of the variance in FS scores.
  • Knowledge level (NR score) explained a significant portion (27%) of the variance in FS scores.
  • FS scores demonstrated considerably higher reliability (mean Cronbach's alpha 0.74) compared to NR scores (mean Cronbach's alpha 0.62).

Conclusions:

  • Formula scoring may impair construct validity by introducing irrelevant variance related to test-taking strategies.
  • Despite potential validity concerns, FS enhances the reliability of progress test scores.
  • Decisions regarding the use of FS in progress testing require a careful balance between systematic and random measurement error.