Undergraduates’ workplace learning in health sciences education: psychometric properties of single-item measures

Affiliations
  • 1Vice-Rectorate for Study Affairs and Clinical Veterinary Medicine, University of Veterinary Medicine Vienna, Veterinaerplatz 1, Vienna, 1210, Austria. evelyn.steinberg@vetmeduni.ac.at.
  • 2Vice-Rectorate for Study Affairs and Clinical Veterinary Medicine, University of Veterinary Medicine Vienna, Veterinaerplatz 1, Vienna, 1210, Austria.
  • 3Department of Educational Science, Saarland University, Campus A4 2, 66123, Saarbrücken, Germany.
  • 4Clinic for Swine, University of Veterinary Medicine Vienna, Veterinaerplatz 1, Vienna, 1210, Austria.
  • 5Clinic for Small Animals, University of Veterinary Medicine Vienna, Veterinaerplatz 1, Vienna, 1210, Austria.
  • 6Centre for E-Learning, Didactics and Educational Research, University of Veterinary Medicine, Bünteweg 11, 30559, Hannover, Germany.

|

Abstract

BACKGROUND

Undergraduates’ workplace learning is an important part of health sciences education. Educational psychology research considers many different aspects of self-regulated learning at the workplace, including cognition, motivation, emotions, and context. Multivariate longitudinal and diary studies in this field require fewer items than alternatives or even a single item per construct and can reveal the sub-processes of workplace learning and contribute to a better understanding of students’ learning. Short instruments are necessary for application in workplace settings, especially stressful ones, to mitigate survey fatigue. The present study aimed to assess the psychometric properties of single items measuring various aspects of workplace learning.

METHODS

Twenty-nine single items selected from the Workplace Learning Inventory in Health Sciences Education were analyzed for reliability, information reproduction, and relationships within the nomological network. The authors additionally analyzed four generally formulated single items’ relationships with the full Workplace Learning Inventory scales and external criteria within the nomological network. Participants were 214 ninth- or tenth-semester veterinary medicine students in Austria and Germany who were learning at varied workplaces during the winter semester of 2021/2022.

RESULTS

Of the 29 single items selected from existing scales, 27 showed sufficient reliability, but mixed results were obtained regarding validity. Although the items’ relationships within the nomological network were similar to those of the full scales, information reproduction was insufficient for most items. The four general single items showed acceptable validity, but the reliability of these measures of states could not be assessed.

CONCLUSIONS

This paper reported findings on the psychometric properties of single items for undergraduates’ workplace learning in health science education. The findings are crucial for deciding whether to use scales versus single-item measures in future studies. By applying the findings, researchers can be more economical in their workplace learning data collection and can include more constructs.

Related Concept Videos

JoVE Research Video for Self-Report Tests of Personality 01:22

144

Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.<br…

JoVE Research Video for Surveys 02:16

14.4K

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

Surveys allow researchers to gather data from larger samples than may be afforded by…

JoVE Research Video for Stereotypes, Prejudice, and Discrimination 02:55

88.2K

Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who…

JoVE Research Video for Assessment of the Cardiovascular System I: Subjective Data 01:23

53

A thorough health history and physical assessment are essential for identifying cardiovascular disease (CVD) symptoms and distinguishing them from other health issues.
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms…

JoVE Research Video for Wechsler's Contribution to Measures of Intelligence 01:23

68

David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence…

JoVE Research Video for Reliability and Validity 01:29

12.3K

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. To illustrate this concept, consider a kitchen…