Related Experiment Video
Updated: Feb 14, 2026

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
Published on: May 13, 2022
Innovations for Evaluation Research: Multiform Protocols, Visual Analog Scaling, and the Retrospective
11 College of Education, Institute for Measurement, Methodology, Analysis, and Policy, Texas Tech University, Lubbock, TX, USA.
Abstract:
In this article, we review three innovative methods: multiform protocols, visual analog scaling, and the retrospective pretest-posttest design that can be used in evaluation research. These three techniques have been proposed for decades, but unfortunately, they are still not utilized readily in evaluation research. Our goal is to familiarize researchers with these underutilized research techniques that could reduce personnel effort and costs for data collection while producing better inferences for a study. We begin by discussing their applications and special unique features. We then discuss each technique's strengths and limitations and offer practical tips on how to better implement these methods in evaluation research. We then showcase two recent empirical studies that implement these methods in real-world evaluation research applications.
Related Concept Videos
pH Scale
Group Design
Scaling
Factorial Design
Design Example: Designing a Residential Plumbing System
Design Example: Designing Water Slide
Bernoulli's principle determines the water's velocity along the slide....

