相关实验视频
Updated: Jun 21, 2025

19:44
A Tactile Automated Passive-Finger Stimulator TAPS
Published on: June 3, 2009
13.7K
作为项目校准工具的ChatGPT:高风险考试中的心理测量见解
Daniela S M Pereira1,2,3, Francisco Mourão4,5, João Carlos Ribeiro4,6,7
1Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Largo do Paço, Braga, Portugal.
Medical teacher
|July 16, 2024
概括
聊天GPT可以自动化测试开发的心理测量分析. 这项研究显示了其在预测高风险考试项目难度方面的潜力,提高了评估校准的效率.
科学领域:
- 人工智能的人工智能
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
背景情况:
- 聊天GPT在自然语言任务中展示了多功能性,包括在教育和评估中的应用.
- 耗时任务的自动化提供了显著的经济和效率效益.
研究的目的:
- 评估ChatGPT在自动化测试问题的心理测量分析方面的能力.
- 评估ChatGPT对预测项目难度和识别高风险考试中不那么有问题的问题的潜力.
主要方法:
- 聊天GPT被查询了100次,来自2020年葡萄牙国家居留选择考试的150个多选题 (MCQ).
- 从ChatGPT的答案计算出项目难度指数,并使用经典测试理论与实际考试数据进行比较.
主要成果:
- 在ChatGPT预测的项目难度指数和实际项目难度之间发现了正相关性 (r = -0.372,p < .001).
- 预测难度和挑战数量 (r = -0.302,p < .001) 之间观察到显著的负相关性,表明识别不那么有问题的项目有潜力.
结论:
- 在评估开发中,ChatGPT显示出作为自动项目校准工具的潜力.
- 该研究强调了ChatGPT在没有预测的情况下预测高风险测试项目的心理特征的能力.
相关概念视频
Instrument Calibration
170
Instrument calibration is essential for ensuring that instruments produce accurate and consistent results. It is vital in manufacturing, healthcare, testing laboratories, and scientific research. Calibration processes are specific to each instrument and help enhance data accuracy. Each instrument has a unique calibration process tailored to its design and function to improve data accuracy.
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
170
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.6K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.6K
Self-Report Tests of Personality
336
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
336
Glassware Calibration
221
Accurate calibration of glassware, such as volumetric flasks, pipettes, and burettes, is essential to ensure accurate measurements in the analytical laboratory. Calibration helps maintain consistency across measurements and prevents errors arising from inaccurate volumes.
Volumetric flasks: Volumetric flasks are designed to prepare aqueous solutions of precise volumes accurately with a calibration line on the neck. To calibrate a volumetric flask, it is important to fill it with distilled...
Volumetric flasks: Volumetric flasks are designed to prepare aqueous solutions of precise volumes accurately with a calibration line on the neck. To calibrate a volumetric flask, it is important to fill it with distilled...
221

