Related Experiment Video
Updated: Jul 9, 2026
06:05
The Participant-Reported Implementation Update and Score (PRIUS): A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
Designing user-centered evaluations: Leveraging beta-testing results to develop process evaluation interview
Jami L Anderson1, Laura Q Rogers2,3, Wendy Demark-Wahnefried3,4
1Department of Family and Community Medicine, Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States of America.
PLOS Digital Health
|July 7, 2026
Summary
Beta-testing feedback refined digital health programs by identifying user needs. This informed user-centered evaluation questions for improved engagement, satisfaction, motivation, and usefulness in health interventions.
Area of Science:
- Digital Health
- Health Behavior
- Cancer Survivorship
Background:
- User-centered design is crucial for digital health program success.
- Incorporating end-user feedback throughout development ensures programs meet user needs.
- Beta-testing provides valuable insights for refining interventions.
Purpose of the Study:
- To describe how beta-testing "think aloud" interviews informed user-centered process evaluation questions.
- To guide the development of interview questions for the AMPLIFY program's efficacy testing.
- To provide a framework for refining digital health interventions based on user feedback.
Main Methods:
- Conducted three "think aloud" interviews with 15 beta-testers over 6 months.
- Analyzed 40 interview transcripts to catalog and categorize suggested refinements.
- Classified refinements by feature reception (liked/disliked/confusing), feasibility, type (formatting/content), and improvement goal (engagement, satisfaction, motivation, usefulness).
Main Results:
- Beta-testing feedback was systematically categorized to identify specific areas for program improvement.
- Refinements were classified into formatting and content changes, linked to user engagement, satisfaction, motivation, and usefulness.
- Results directly informed the design of semi-structured interview questions for the program's efficacy testing phase.
Conclusions:
- Beta-testing "think aloud" interviews are effective for gathering user feedback to refine digital health programs.
- Systematic analysis of feedback can guide the development of targeted process evaluation questions.
- This approach offers a valuable model for researchers developing and evaluating digital health interventions.
Related Concept Videos
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Evaluation of the teaching process enables the nurse to determine if the patient's learning needs were met and if training was effective. If the expected outcomes are not met, the care plan is revised, and additional education or reinforcement is provided. Nurses can ask questions after the session or obtain feedback to assess the patient's understanding of the topic.
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning, patient...
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning, patient...
01:15Nursing Evaluation
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
Section...
Section...
01:22Amplifying Signals via Enzymatic Cascade
When a ligand binds to a cell-surface receptor, the receptor's intracellular domain changes shape, which may either activate its enzyme function or allow its binding to other molecules. The initial signal is amplified by most signal transduction pathways. This means that a single ligand molecule can activate multiple molecules of a downstream target. Proteins that relay a signal are most commonly phosphorylated at one or more sites, activating or inactivating the protein. Kinases catalyze the...
03:00Self-Evaluation: Self-Enhancement and Self-Verification
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
01:28Methods of Medium Optimization
Optimizing growth media enhances microbial proliferation and maximizes product yield. Statistical experimental design methodologies provide structured and reproducible approaches, offering progressively higher levels of robustness and efficiency.The One-Factor-at-a-Time (OFAT) MethodThe One-Factor-at-a-Time (OFAT) method involves adjusting a single variable while keeping all others constant. However, it cannot detect interactions between variables, often leading to suboptimal outcomes when...
02:40The Scientific Method
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.