Related Experiment Video
Updated: May 8, 2026
07:43
A Naturalistic Setup for Presenting Real People and Live Actions in Experimental Psychology and Cognitive Neuroscience Studies
Published on: August 4, 2023
Use of controlled vignettes in evaluation: does type of response method make a difference?
1Department of Occupational Therapy, Colorado State University, Fort Collins, CO 80523, USA.
Evaluation and Program Planning
|September 10, 2013
Summary
The forced choice vignette method positively impacted views on supported employment for students in occupational therapy programs. This evaluation tool assessed curriculum changes regarding transition competencies for individuals with cognitive disabilities.
Area of Science:
- Program Evaluation
- Occupational Therapy Education
- Cognitive Disability Employment
Background:
- Vignettes are a method for program evaluation.
- Two studies utilized vignettes to assess student perceptions of job applicant performance.
- Participants included pre-occupational therapy, professional occupational therapy, and business students.
Purpose of the Study:
- To evaluate the impact of a training grant focused on integrating transition competencies into occupational therapy curricula.
- To compare the effectiveness of rating scale versus forced choice vignette methods in program evaluation.
- To assess student perceptions of hypothetical job applicant performance with cognitive disabilities in various employment settings.
Main Methods:
- Two vignette-based studies were conducted.
- Study 1 used a rating scale method.
- Study 2 employed a forced choice decision method, with participants evaluating applicant performance in segregated, supported, or competitive employment settings.
Main Results:
- The forced choice vignette method yielded statistically significant positive outcomes regarding supported employment.
- The training grant demonstrated a significant positive influence on student perceptions.
- Differences in outcomes were observed between the rating scale and forced choice methods.
Conclusions:
- The forced choice vignette method is effective in evaluating the impact of curriculum modifications on student attitudes toward supported employment.
- The training grant successfully influenced occupational therapy students' views on employment for individuals with cognitive disabilities.
- Further research should consider the external validity of vignette-based evaluation tools.
Related Concept Videos
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
01:37Statistical Significance
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
02:07Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
01:12What is an Experiment?
An experiment is a planned activity carried out under controlled conditions. The purpose of an experiment is to investigate the relationship between two variables. When one variable causes change in another, we call the first variable the explanatory or independent variable. The affected variable is called the response or dependent variable. In a randomized experiment, the researcher manipulates values of the explanatory variable and measures the resulting changes in the response variable. The...
02:30Naturalistic Observations
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...