聊天GPT可以获得工程学位吗? 评估高等教育对人工智能助理的脆弱性
Beatriz Borges1, Negar Foroutan1, Deniz Bayazit1
1École Polytechnique Fédérale de Lausanne (EPFL), Lausanne 1015, Switzerland.
概括
像ChatGPT这样的生成人工智能 (AI) 助理可以回答超过65%的大学STEM评估问题. 这一漏洞需要对高等教育评估策略进行重新评估,以确保学术完整性和学习成果.
科学领域:
- 高等教育 高等教育
- 人工智能的人工智能
- 教育技术的教育技术
背景情况:
- 在高等教育中,学生对人工智能助理的使用正在增加.
- 生成型人工智能对学术评估和学习成果提出了挑战.
- "脆弱性"的概念框架了人工智能对大学评估的影响.
研究的目的:
- 评估人工智能助理完成大学水平的STEM评估问题的能力.
- 量化高等教育评估对生成人工智能的脆弱性.
- 根据人工智能的进步,对评估设计进行修订.
主要方法:
- 编制了EPFL的50个STEM课程评估问题的数据集.
- 在这些问题上评估了人工智能助理的表现 (GPT-3.5和GPT-4).
- 利用八种不同的提示策略来引起AI的响应.
主要成果:
- 平均而言,GPT-4正确回答了65.8%的评估问题.
- 通过使用至少一个提示策略,GPT-4为85.1%的问题提供了正确的答案.
- 人工智能系统在许多核心STEM课程中证明了通过非项目评估的能力.
结论:
- 目前的AI模型对高等教育评估的完整性构成重大风险.
- 人工智能在完成评估方面的能力可能会增加,从而放大风险.
- 高等教育机构必须修改评估设计,以应对产生性AI的影响.
相关概念视频
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
Mechanical Efficiency of Real Machines
637
The mechanical efficiency of a machine is a fundamental concept that describes how effectively a machine can convert input work into output work. According to this concept, the efficiency of a machine is equal to the ratio of the output work to the input work. An ideal machine, meaning a machine that has no energy losses, has an efficiency of one. This implies that the input work and the output work are equal.
However, in reality, no machine can be truly ideal, and all of them experience some...
However, in reality, no machine can be truly ideal, and all of them experience some...
637
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Current Trends in Nursing II
1.2K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.2K
Machines: Problem Solving II
296
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
296


