Related Experiment Video
Updated: Apr 2, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
Published on: December 23, 2025
Blinded But Biased: Students Prefer Chatbot Until They Know It Is One
Joshua Lambert1, Bailey E Martin1, Robyn Stamm1
1College of Nursing, University of Cincinnati, Cincinnati, Ohio.
Background:
As artificial intelligence (AI) becomes increasingly integrated into education, understanding student perceptions of AI-generated support is critical. This pilot study examined how Doctor of Nursing Practice (DNP) students evaluate statistical help from different sources.
Method:
Seven DNP students submitted statistical questions related to their capstone projects and received blind responses from a custom-trained, large language model (LLM) chatbot; a graduate assistant; and a professor. Students rated each response on helpfulness, satisfaction, and likelihood of use (i.e., 1 = worst, 5 = best), and guessed which response came from the chatbot.
Results:
The LLM chatbot received the highest average ratings for helpfulness and satisfaction. However, students consistently rated responses lower when they believed they were AI-generated.
Conclusion:
Students preferred the LLM chatbot's responses when blinded yet demonstrated a bias against AI when the source was suspected. This bias may influence AI adoption in academic support and warrants further study.
Related Concept Videos
Surveys
Factors Influencing Attraction V: Social Skills
The Availability Heuristic
Persuasion Strategies
Mate Choice
Confirmation Biases