関連する実験動画
Updated: Jul 10, 2026

08:12
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Berezinskii-Kosterlitz-Thouless トランジションは,文脈に敏感なランダム言語モデルのランダム言語モデルである
Yuma Toji1, Jun Takahashi2, Vwani Roychowdhury3
1Hokkaido University, Graduate School of Information Science and Technology, Sapporo, Hokkaido 060-0814, Japan.
Physical review. E
|February 20, 2026
まとめ
研究者らは,物理学にインスパイアされた新しい言語モデルで相変化を実演しています. この発見は,自然言語の重要な性質は,単なる微調整ではなく,Berezinskii-Kosterlitz-Thouless (BKT) 段階から生じる可能性があることを示唆しています.
科学分野:
- 統計物理学 統計物理
- コンピュータ言語学 コンピュータ言語学
- 自然言語処理 (Natural Language Processing) とは,自然言語処理で処理される言語のことです.
背景:
- 自然言語における力法則の重要な性質は,物理システムの相変化に似ている.
- 大型言語モデル (LLM) は,スケーリング法則のような物理学の概念との類似性を示しています.
- 統計物理で定義された相移行を示す生成言語モデルを特定する際にはギャップが存在します.
研究 の 目的:
- 段階移行を示す確率言語モデルを構築・分析する.
- 自然言語モデリングに統計物理学の概念の適用性を調査する.
- 自然言語における重要な性質の性質を探求する.
主な方法:
- 1Dポッツモデルにインスパイアされた文脈に敏感なランダム言語モデルを開発しました.
- モデルパラメータのチューニングにより,曖昧な相変化を数値的に実証した.
- シンボル周波数バイアスを捕捉するオーダーパラメータを定義,分析した.
主要な成果:
- 順序パラメータは,無限長さの限界においてゼロから非ゼロに移行し,奇点を示した.
- 移行をベレジンスキー-コステルリッツ-トゥーレス (BKT) 移行の変種として識別した.
- 一次元のシステムで観測されたBKTの相特性,珍しい現象.
結論:
- 自然言語の重要な特性は,BKTの段階によって一般的に説明されるかもしれません.
- これは,言語の性質を説明するために,微調整または自己組織化された批判性の必要性に挑戦しています.
- この研究は,1DシステムにおけるBKT相の希少な例であり,物理学と言語学に意味を持つ.
関連する概念動画
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
Random Variables
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Entropy Change in Reversible Processes
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Propagation of Uncertainty from Random Error
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
Transition State Theory
Transition-state theory, also known as activated-complex theory, provides a molecular-level explanation of reaction rates in both gas-phase and solution-phase reactions. It extends earlier kinetic models by considering the formation of a short-lived, high-energy configuration during a reaction.The progress of a chemical reaction can be represented using a reaction profile, which plots potential energy against the reaction coordinate. As two reactant molecules approach one another, their...
Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
