Related Experiment Video
Updated: Aug 2, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
The validity of lecturer ratings by students and trained observers
M A Albanese1, S S Schuldt, D E Case
1Department of Preventive Medicine and Environmental Health, University of Iowa College of Medicine, Iowa City 52242.
Abstract:
This study sought to determine to what degree student ratings of specific lecturer characteristics relate to trained observer ratings of such characteristics and to identify the distinguishing delivery characteristics of highly rated lecturers. The 15 lowest-rated lecturers and the 15 highest-rated lecturers, based on the mean ratings of students from two consecutive years (1982 and 1983) in a large multi-instructor course, served as the target group. Blinded non-student raters observed the lectures in 1984 (two per lecture) and completed quantitative and qualitative forms. For all six subscores from the quantitative form, statistically significant differences between the lecturers given the highest and lowest ratings were obtained. It is concluded that the students' ratings were stable across the three years; the independent observers discriminated between the lecturers the students rated the highest and the lowest; voice presentation characteristics discriminated the most effectively; and nonmedical non-student observers are potentially a useful source of information regarding faculty teaching skills.
Related Concept Videos
Naturalistic Observations
Surveys
Reliability and Validity
Ratio Level of Measurement
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated. For...
Comparing Experimental Results: Student's t-Test
Theory of Attribution II: Kelley's Covariation Theory