幻覚,モノファクト,ミスカリブレーション: 経験的調査
Miranda Muqing Miao1, Michael Kearns1
1Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA 19104.
まとめ
大型言語モデル (LLM) は,モノファクト率とミスカリブレーションの影響で,事実を幻覚化します. 選択的アップウェイトは,精度を保ちながら,幻覚を40%減少させ,デデプリケーションに挑戦します.
科学分野:
- 自然言語処理 (Natural Language Processing) とは,自然言語処理で処理される言語のことです.
- 機械学習理論について
- 統計学学習 統計学学習
背景:
- 大型言語モデル (LLM) は幻覚の事実を示し,これは理論的にはモノファクト率とモデルミスカリブレーションに関連している現象である.
- 既存の研究は,これらの要因に基づいて幻覚の統計的下限を示唆しています.
- この関係を理解するために,異なるモデルアーキテクチャの間の経験的検証が必要である.
研究 の 目的:
- 古典的なn-gramとトランスフォーマーモデルにおけるモノファクト率,ミスカリブレーション,および幻覚の間の関係を実証的に調査する.
- 経験的な幻覚を発展させ,検証する.
- モデルの精度を損なうことなく幻覚を緩和するためのテクニックを探求する.
主な方法:
- モノファクト率を制御するために,パレート分布から生成されたトレーニングデータ.
- 双方向的なKullback-Leibler (KL) 偏差を用いた経験的な幻覚の導出.
- 訓練の例を戦略的に繰り返すことによる選択的なアップウェイト技術の導入と評価.
主要な成果:
- モノファクト率と幻覚レベルとの間の正の相関が確立されました.
- 経験的な幻覚の境界は,実用的な実用性を実証しました.
- 選択的加重は,精度を保ちながら,幻覚を最大40%減少させました.
- 標準的なトレーニングは精度を向上させましたが,持続的な幻覚を効果的に軽減することはありませんでした.
結論:
- LLMにおける幻覚は,モノファクト率とモデルミスカリブレーションと経験的に関連しています.
- 選択的アップウェイトは,普遍的なデデプリケーションに挑戦し,幻覚を軽減するための実行可能な戦略を提供します.
- 標準的な訓練目標において,精度向上と幻覚の減少との間のトレードオフが存在します.
関連する概念動画
Cause and Effect
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
Gestalt Principles of Perception
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
Extrasensory Perception
Extrasensory perception, or ESP, suggests the ability to perceive events beyond the conventional senses of sight, hearing, and touch. Parapsychologists, who research ESP and related psychic phenomena, categorize ESP into three main types: precognition, telepathy, and clairvoyance.
Precognition involves foreseeing future events, such as predicting an accident before it happens. An example of precognition could be someone dreaming about a specific event, like a car crash, which then occurs...
Precognition involves foreseeing future events, such as predicting an accident before it happens. An example of precognition could be someone dreaming about a specific event, like a car crash, which then occurs...
False Memories
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information with...
One primary source of false memories is misattribution, where individuals incorrectly associate external information with...
Magical Thinking
Magical thinking encompasses the belief in assumptions that defy logical reasoning yet appear intuitively convincing. It is a common psychological phenomenon that persists across various cultural and individual contexts. While these assumptions contradict empirical evidence and scientific laws, they often serve meaningful psychological roles in promoting emotional resilience and a sense of control, especially under stress or uncertainty.Thought-Action Fusion and the Law of SimilarityA key...


