生物医学記事の証拠を要約するために大規模な言語モデルを使用する:AIと人間の注釈された文献誌の探査比較
Michelle Colder Carras1, Riaz Qureshi2, Kevin Naaman2
1Department of International Health, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe St, Baltimore, MD, 21205, United States, 1 410-955-3934.
JMIR formative research
|February 12, 2026
まとめ
ChatGPTを使用したAIで生成された注釈は,科学文献の迅速な概要を提供し,一貫した品質と文脈を提供しますが,潜在的な不正確さと人間の注釈よりも多くのエラーがあります. 人工知能によって作成された注釈付き図鑑には,人間による慎重な検証が推奨されます.
科学分野:
- 人工知能 (AI) とは,人工知能 (AI) のことです.
- 自然言語処理 (Natural Language Processing) とは,自然言語処理で処理される言語のことです.
- 科学的コミュニケーション 科学的コミュニケーション
背景:
- アノテーション付きの文献は文献レビューには極めて重要ですが,かなりの人の専門知識と時間を要します.
- 人工知能のツールは,効率的な要約の可能性を秘めていますが,エラーを導入する可能性があります.
研究 の 目的:
- アノテーション付き図鑑を作成するためにChatGPTを使用する可能性を評価する.
- 精度,簡潔性,品質に関して,AIによって生成された注釈を,人間によって書かれた注釈と比較する.
主な方法:
- 2人の人間アノテーターと3つのバージョンのChatGPT (3.5,4,5) が独立して15の出版物をアノテしました.
- アノテーションは,単語の数,読みやすさ (Flesch Reading Ease),主なポイントの把握,エラーの存在,および品質/文脈の含有について評価されました.
- 統計モデルを使用して,人間とAIによって生成された注釈を比較しました.
主要な成果:
- チャットGPTの注釈は,人間の注釈よりも長く,読解が困難でした.
- AIと人間の注釈の間の主なポイントを捉えるのに有意な違いは見つかりませんでした.
- 人間のアノテーションは誤差が少なく,AIのアノテーションは品質と文脈をより一貫して含んでいたが,時には不正確だった.
結論:
- ChatGPTのようなAIツールは,一貫した品質と文脈を提供し,文献要約を効率的に生成できます.
- AIによって生成された注釈には,より多くの誤りや不正確性が含まれており,人間の検証が必要になります.
- 科学文献の要約のためのAIチャットボットのパフォーマンスを高めるために,迅速なエンジニアリングに関するさらなる研究が必要です.
さらに関連する動画
関連する概念動画
02:55The Evidence for Evolution
48.4K
Genetic variations accumulating within populations over generations give rise to biological evolution. Evolutionary changes can result in the formation of novel varieties and entire new species. These changes are responsible for the diverse forms of life inhabiting the planet. The evidence for evolution suggests that all living organisms descended from common ancestors.
48.4K
01:16Language
921
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
921
03:36Genome Annotation and Assembly
21.1K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
21.1K
01:26Pharmacokinetic Models: Comparison and Selection Criterion
373
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
373
01:24Components of Language
831
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
831
01:22Language Development
939
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
939