Related Experiment Video
Updated: Oct 21, 2025

A Co-culture Method to Investigate the Crosstalk Between X-ray Irradiated Caco-2 Cells and PBMC
Published on: January 30, 2018
Inter-rater reliability of occupational exposure assessment in a case-control study of female breast cancer
E Batisse1, F Labrèche2,3, M S Goldberg1,4,5
1Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada.
Abstract:
The objective of this paper was to estimate the inter-rater reliability of expert assessments of occupational exposures. An inter-rater reliability sub-study was conducted within a population-based case-control study of postmenopausal breast cancer. Detailed information on lifetime occupational histories was obtained from participants and two industrial hygienists assigned exposures to 185 jobs using a checklist of 293 agents. Experts rated exposure for each job-agent combination according to exposure status (unexposed/exposed), confidence that the exposure occurred (possible/probable/definite), intensity (low/medium/high), and frequency (% time per week). The statistical unit of observation was each job-agent assessment (185 jobs × 293 agents = 54,205 assessments per expert). Crude agreement, Gwet AC1/2 statistics, and Cohen's Kappa were used to estimate inter-rater agreement for confidence and intensity; for frequency, the intra-class correlation coefficient (ICC) was used. The majority of job-agent combinations were evaluated by the two experts to be not exposed (crude agreement >98% of decisions). The degree of agreement between the experts for the confidence of exposure status was Gwet AC1/2 = 0.99 (95% CI: 0.99-0.99), and for intensity, a Gwet AC2 = 0.99 (95% CI: 0.99-0.99). For frequency, an ICC of 0.31 (95% CI: 0.26-0.35) was found. A sub-analysis restricted to job-agent combinations for which the two experts agreed on exposure status revealed a moderate agreement for confidence of exposure (Gwet AC2 = 0.66) and high agreement for intensity (Gwet AC2 = 0.96). For frequency, the ICC was 0.52 (95% CI: 0.47-0.57). A high level of inter-rater agreement was found for identifying exposures and for coding intensity, but agreement was lower for the coding of frequency of exposure.
Related Concept Videos
Relative Risk
Odds Ratio
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Hazard Ratio
For example, in a clinical trial...
Statistical Methods for Analyzing Epidemiological Data
Comparing the Survival Analysis of Two or More Groups

