Related Experiment Video
Updated: Jul 8, 2026
08:33
A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic
Greg Kestin1, Kelly Miller2, Anna Klales3
1Department of Physics, Harvard University, 17 Oxford Street, Cambridge, MA, 02138, USA. Kestin@fas.Harvard.edu.
Scientific Reports
|June 19, 2025
Summary
Generative artificial intelligence tutors significantly enhance college student learning and engagement compared to traditional active learning methods. This AI-powered pedagogy offers a more efficient and motivating educational experience.
Area of Science:
- Educational Technology
- Artificial Intelligence in Education
- Pedagogical Innovations
Background:
- Generative artificial intelligence (AI) presents opportunities for educational advancement.
- Optimal implementation and effectiveness of AI tutors versus established pedagogical methods remain underexplored.
Purpose of the Study:
- To compare the efficacy of an AI-powered tutor against traditional active learning in a college setting.
- To evaluate student learning outcomes and perceptions using AI versus in-class instruction.
Main Methods:
- A randomized controlled trial was conducted with college students.
- Learning and perceptions were measured comparing a custom AI tutor (based on pedagogical best practices) with an active learning classroom.
Main Results:
- Students demonstrated significantly greater learning gains with the AI tutor in less time.
- AI tutor users reported higher levels of engagement and motivation compared to the control group.
Conclusions:
- AI-powered pedagogy, exemplified by the custom AI tutor, significantly enhances learning outcomes.
- The findings support the broad adoption of AI tutors as an effective and accessible educational tool.
Related Concept Videos
01:13Randomized Experiments
7.9K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.9K
01:16Experimental Designs
15.1K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
15.1K
01:11Blinding
3.2K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
3.2K
01:21Cognitive Learning
668
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
668
01:22Purposive Learning
210
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
210
01:12Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321