Video Experimental Relacionado
Updated: Jan 7, 2026
07:32
Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity
Published on: February 10, 2016
9.8K
Evaluación comparativa de preguntas de opción múltiple generadas por ChatGPT frente a ítems de profesores en
Amber Kiyani1, Fariha Hanif2, Muhammad Muhammad2
1Qatar University, Doha, Qatar. a.kiyani@qu.edu.qa.
Scientific reports
|December 29, 2025
Resumen
This study compared ChatGPT-generated multiple-choice questions (MCQs) with instructor-written ones for dental students. Instructor items performed better, but AI-generated questions show future potential in educational assessments.
Área de la Ciencia:
- Tecnología Educativa; Inteligencia Artificial en la Educación; Educación Médica
Sus antecedentes:
- Los modelos de lenguaje grandes (LLM) se utilizan cada vez más en el autoaprendizaje de los estudiantes.; Es crucial evaluar la calidad del contenido educativo generado por IA para una integración efectiva.; La evaluación comparativa de herramientas de IA con métodos tradicionales proporciona información sobre su utilidad.
Objetivo del estudio:
- Comparar las propiedades psicométricas de los ítems de evaluación generados por ChatGPT-3.5 con los creados por instructores.; Evaluar el rendimiento de las preguntas de opción múltiple (POM) generadas por IA en un contexto de Medicina Oral para estudiantes de odontología de pregrado.; Analizar la confiabilidad, dificultad y discriminación de los ítems de evaluación generados por IA y creados por instructores.
Principales métodos:
- Se desarrolló una evaluación de Medicina Oral de 40 ítems, que comprende 20 POM creadas por instructores y 20 por ChatGPT-3.5.; La evaluación se administró a 547 estudiantes de odontología de pregrado en cuatro instituciones.; Se utilizó la Teoría de Respuesta al Ítem, específicamente el modelo logístico de 3 parámetros, para el análisis de datos.
Principales resultados:
- Los ítems del instructor demostraron una mayor confiabilidad de la persona (0.845) en comparación con los ítems de ChatGPT (0.778).; Los ítems del instructor mostraron un rango de dificultad más amplio (-1.29 a 3.22) y una mayor discriminación (0.50 a 4.64) que los ítems de ChatGPT.; Si bien los ítems del instructor tuvieron puntajes promedio más altos y variabilidad, los ítems de ChatGPT exhibieron propiedades psicométricas prometedoras con un bajo parámetro de adivinanza.
Conclusiones:
- Los ítems de evaluación generados por la facultad exhiben actualmente propiedades psicométricas superiores, incluida una mejor discriminación y rango de dificultad.; Los ítems generados por ChatGPT muestran potencial para la generación de POM en entornos educativos, lo que justifica una mayor investigación.; Los LLM como ChatGPT pueden desempeñar un papel importante en el desarrollo de futuras evaluaciones educativas, superando potencialmente las capacidades humanas.
Palabras clave:
EvaluacionesChatGPTEducación dentalModelos de lenguaje grandesEstudiantesUniversidadesMás Videos Relacionados
13:44Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
4.1K
07:42Quasistatic Mechanical Testing for Computer-Aided Design and Manufacturing Occlusal Veneers Cemented to Milled Dentin Analog Material
Published on: December 20, 2024
683
Videos de Conceptos Relacionados
01:26Assessment of the Mouth
962
A thorough mouth assessment, including inspection and palpation of the lips, gums, tongue, tonsils, uvula, and pharynx, is crucial in detecting potential health issues. Diseases ranging from oral cancer to systemic conditions like diabetes could be identified early through careful oral examination. This article provides a detailed guide on conducting a comprehensive mouth assessment.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
962
02:16Surveys
16.6K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
16.6K
01:20Biostatistics: Overview
687
Biostatistics plays a crucial role in understanding and analyzing data in healthcare and biology. Biostatisticians conduct experiments, gather evidence, and draw meaningful conclusions using statistical methods and techniques. Different variables form the foundation of biostatistical analysis, allowing researchers to understand and interpret data effectively. These variables are classified into different types, each serving a specific purpose in statistical analysis.
Discrete variables are...
Discrete variables are...
687
01:08The Availability Heuristic
6.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.9K
01:09Comparing Experimental Results: Student's t-Test
4.7K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
4.7K
01:10Pre-Procedural Guidelines for Assessing Blood Pressure
788
Accurate blood pressure assessment is crucial for diagnosing and managing various health conditions. To ensure the reliability of these measurements, healthcare professionals must adhere to standardized pre-procedural guidelines. These guidelines enhance patient safety and improve the overall quality of healthcare. The following steps are essential for obtaining accurate and consistent blood pressure readings, from using the appropriate tools to ensuring effective communication with the...
788