Related Experiment Video
Updated: Jan 16, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
An International Comparative Reliability and Concurrent Validity Assessment of the Multi-Level Job Content
Wilfred Agbenyikey1,2, Jian Li3, Sung-Il Cho4
1US Department of Health and Human Services, Center for Medicare and Medicaid Services, Baltimore, MD 21244, USA.
Background:
This paper empirically tests the new multi-level Associationalist Demand Control (ADC) theory by applying the Job Content Questionnaire (JCQ) 2.0 that assesses both a wide range of task characteristics as well as work organizational and external-to-work psychosocial characteristics.
Methods:
The paper is based on four JCQ 2.0 pilot studies among 16,125 workers in Korea, China, Australia, and Germany. All pilots used the original JCQ task-level scales and then added newly developed proposed items and scales, evolving more comprehensive higher-level scales from pilot to pilot from 2005 to 2011. A brief review of the analytic process is presented, followed by an assessment of the internal consistency and concurrent validity of the final 25 multi-level JCQ 2.0 scales at the task, the organizational, and the external levels.
Results:
Adequate psychometric properties were established for the JCQ 2.0 pilot scales. The extended set of task-level scales was found to be robust across all samples; the new organizational scales mainly showed adequate internal consistency with α > 0.7 in Australia and Germany (tested only there) and were associated with relevant work- and health-related outcome measures as expected. Similarly, the external-to-work scales (tested only in Germany) had adequate Cronbach's Alpha values and showed expected associations to relevant outcome scales.
Conclusions:
Although not all scales were available in all countries, overall, the results support the "functional similarity" of the major scale areas across the four pilot countries and support the underlying extensions of the Demand-Control theoretical constructs to the multi-level psychosocial work assessment for the promotion of workers' health and wellbeing as suggested by the new ADC model.
Related Concept Videos
Reliability and Validity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Self-Report Tests of Personality
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Wechsler's Contribution to Measures of Intelligence
Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...

