检查负责任地使用零射击人工智能方法来评分论文的责任
1Educational Testing Service, Research Division, 08541, Princeton, New Jersey, USA. msjohnson@ets.org.
Scientific reports
|December 3, 2024
概括
人工智能 (AI) 提供了评分和写作指令的潜力,但在教育中负责任地使用它需要的不仅仅是准确性. 本研究概述了AI在评估中的原则,重点关注公平,透明和可解释性.
科学领域:
- 教育技术的教育技术.
- 教育中的人工智能
- 评估和评价的评估和评估.
背景情况:
- 人工智能 (AI) 在教育中的整合为分级和教学增强提供了机会.
- 负责任的AI实施需要一个超越纯粹准确性的框架,解决道德和实际考虑.
- 政府和非政府机构的现有指南为AI在教育评估中的原则提供了信息.
研究的目的:
- 将现有的人工智能治理原则综合化为在教育评估中负责任地使用人工智能的框架.
- 调查人工智能驱动的评估工具中的公平性和偏见缓解.
- 探索AI自动化评分模型的透明度和可解释性.
主要方法:
- 来自NIST,联合国,教科文组织和经合组织等机构的综合指导.
- 在评估中制定了负责任的AI原则:公平,隐私,透明度,教育影响和持续改进.
- 使用GPT-4o对零射击得分进行实证评估,重点关注公平性和可解释性.
主要成果:
- 人工智能准确性是教育影响和完整性的组成部分,而不是负责任使用的唯一决定因素.
- 该研究强调公平性和偏见缓解是AI在评估中的关键原则.
- 经验评估证明了GPT-4o的零射击得分能力,通过对公平性和可解释性的分析.
结论:
- 教育中的负责任人工智能需要一个多方面的方法,包括公平,透明和问责制.
- 开发的原则为在教育评估环境中道德地部署人工智能提供了基础.
- 进一步的研究和经验评估对于确保人工智能对教育产生有益和公平的影响至关重要.
更多相关视频
04:54Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research
Published on: November 8, 2024
447
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
502
相关概念视频
01:16Non-equilibrium in the Cell
4.2K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.2K
01:29Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
01:56Ethics in Research
22.9K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
22.9K
02:53CRISPR and crRNAs
16.7K
Bacteria and archaea are susceptible to viral infections just like eukaryotes; therefore, they have developed a unique adaptive immune system to protect themselves. Clustered regularly interspaced short palindromic repeats and CRISPR-associated proteins (CRISPR-Cas) are present in more than 45% of known bacteria and 90% of known archaea.
The CRISPR-Cas system stores a copy of foreign DNA in the host genome and uses it to identify the foreign DNA upon reinfection. CRISPR-Cas has three different...
The CRISPR-Cas system stores a copy of foreign DNA in the host genome and uses it to identify the foreign DNA upon reinfection. CRISPR-Cas has three different...
16.7K
02:16Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
02:16Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K