Jove
Visualize
Contact Us

Related Experiment Videos

A meta-analysis of job analysis reliability.

Erich C Dierdorff1, Mark A Wilson

  • 1Department of Psychology, North Carolina State University, Raleigh 27695-7801, USA.

The Journal of Applied Psychology
|August 28, 2003
PubMed
Summary

Job analysis reliability varies by data type and rater. Task data generally shows higher reliability than generalized work activities, with frequency and importance scales being most dependable for accurate job descriptions.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Colonization of empty shells by cryptic fauna: a global event and important ecological innovation in Ordovician benthic ecosystems.

Scientific reports·2026
Same author

Rethinking Suicide Thi4 Thiazole Synthases: Comparative Genomic Insights and Pilot Functional Evidence.

ACS omega·2026
Same author

Towards time-resolved MicroED grid preparation using mix-and-inject gas dynamic virtual nozzles.

IUCrJ·2026
Same author

Conformational flexibility of soybean lipoxygenase is coupled to crystal solvent content in serial crystallography.

bioRxiv : the preprint server for biology·2026
Same author

Glyoxalase activities of Parkinson's disease relevant protein DJ-1/PARK7: Past discoveries and future perspectives.

Proceedings of the Japan Academy. Series B, Physical and biological sciences·2026
Same author

Environmental Contributions to Proton Sharing in Protein Low-Barrier Hydrogen Bonds.

Biochemistry·2026
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Area of Science:

  • Industrial-Organizational Psychology
  • Human Resources Management
  • Occupational Science

Background:

  • Reliability is crucial for accurate job analysis, impacting various HR functions.
  • Previous research shows mixed findings on reliability across different job analysis methods.
  • Understanding factors influencing reliability is essential for practical application.

Purpose of the Study:

  • To systematically investigate average levels of interrater and intrarater reliability in job analysis.
  • To identify how data specificity, source, and descriptive scales affect reliability estimates.
  • To provide evidence-based recommendations for improving job analysis practices.

Main Methods:

  • Conducted a meta-analysis of 46 studies, cumulating 299 reliability estimates.
  • Categorized data by specificity (generalized work activity vs. task data), source (incumbents, analysts, experts), and descriptive scale.
  • Applied the Spearman-Brown formula to correct reliability estimates for scale length and number of raters.

Main Results:

  • Task data initially showed higher interrater reliability but lower intrarater reliability than generalized work activity data.
  • After corrections, task data demonstrated superior interrater and intrarater reliabilities.
  • Incumbent raters yielded the lowest reliability estimates; frequency and importance scales were most reliable.

Conclusions:

  • Job analysis reliability is influenced by the level of data specificity and the rater source.
  • Task-level data and specific scales (frequency, importance) enhance reliability.
  • Findings suggest practical implications for selecting methods and training raters in job analysis.

Related Experiment Videos