Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Statistical methodology: II. Reliability and variability assessment in study design, Part A

D J Karras1

  • 1Division of Emergency Medicine, Temple University, School of Medicine, Philadelphia, PA 19140, USA. dkarras@astro.ocis.temple.edu

Academic Emergency Medicine : Official Journal of the Society for Academic Emergency Medicine
|January 1, 1997
PubMed
Summary

Assessing test reliability and validity is complex. Correlation indexes may inaccurately reflect test result correspondence; examining interest differences offers a better approach for reliable measurement.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Circadian differences among 4,096 emergency department patients with acute asthma.

Critical care medicine·2001
Same author

Serum markers in the emergency department diagnosis of acute myocardial infarction.

Emergency medicine clinics of North America·2001
Same author

Clinically meaningful changes in quantitative measures of asthma severity.

Academic emergency medicine : official journal of the Society for Academic Emergency Medicine·2000
Same author

Endogenous mediators in emergency department patients with presumed sepsis: are levels associated with progression to severe sepsis and death?

Annals of emergency medicine·1999
Same author

Incidence of foodborne illnesses: preliminary data from the foodborne diseases active surveillance network (FoodNet).

Annals of emergency medicine·1999
Same author

Tick removal.

Annals of emergency medicine·1998

Area of Science:

  • Psychometrics
  • Statistical analysis

Background:

  • Assessing test reliability and validity is often complex.
  • Correlation indexes, commonly used for interest agreement, measure only linear relationships, potentially misrepresenting test result correspondence.
  • Alternative methods like inspecting interest differences or using the kappa statistic may offer more accurate assessments.

Purpose of the Study:

  • To highlight the limitations of correlation in assessing test reliability and validity.
  • To introduce alternative methods for evaluating the correspondence between test results.
  • To discuss practical approaches for determining reliability from single test administrations.

Main Methods:

  • Review of statistical methods for assessing test reliability and validity.
  • Comparison of correlation indexes with methods like visual inspection of interest differences and the kappa statistic.

Related Experiment Videos

  • Discussion of techniques for assessing reliability from single test administrations.

    • Main Results:

    • Correlation indexes may not accurately reflect the correspondence between test results.
    • Inspection of interest differences can provide a better indicator of correspondence and account for measurement biases.
    • The kappa statistic is suitable for measuring the association between categorical variables.

    Conclusions:

    • Relying solely on correlation for test reliability and validity can be misleading.
    • Alternative methods, such as analyzing interest differences, offer more nuanced assessments.
    • Further exploration of validity and methods to enhance questionnaire reliability and validity will be presented in Part B.