Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Woodward–Hoffmann Selection Rules and Microscopic Reversibility01:34

Woodward–Hoffmann Selection Rules and Microscopic Reversibility

Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
Random Variables01:09

Random Variables

A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Entropy Change in Reversible Processes01:10

Entropy Change in Reversible Processes

In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Propagation of Uncertainty from Random Error00:59

Propagation of Uncertainty from Random Error

An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
Transition State Theory01:25

Transition State Theory

Transition-state theory, also known as activated-complex theory, provides a molecular-level explanation of reaction rates in both gas-phase and solution-phase reactions. It extends earlier kinetic models by considering the formation of a short-lived, high-energy configuration during a reaction.The progress of a chemical reaction can be represented using a reaction profile, which plots potential energy against the reaction coordinate. As two reactant molecules approach one another, their...
Language and Cognition01:27

Language and Cognition

Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Granulomatous mastitis during pregnancy with sudden onset of gait difficulty and erythema nodosum: A case report and review of the literature.

The journal of obstetrics and gynaecology research·2024
Same author

Information geometric bound on general chemical reaction networks.

Physical review. E·2024
Same author

Emergent invariance and scaling properties in the collective return dynamics of a stock market.

PloS one·2024
Same author

Quantum advantage in variational Bayes inference.

Proceedings of the National Academy of Sciences of the United States of America·2023
Same author

Ansatz-Independent Variational Quantum Classifiers and the Price of Ansatz.

Scientific reports·2022
Same author

Pretreatment with Perlecan-Conjugated Laminin-E8 Fragment Enhances Maturation of Grafted Dopaminergic Progenitors in Parkinson's Disease Model.

Stem cells translational medicine·2022

Related Experiment Video

Updated: Jul 10, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Berezinskii-Kosterlitz-Thouless transition in a context-sensitive random language model.

Yuma Toji1, Jun Takahashi2, Vwani Roychowdhury3

  • 1Hokkaido University, Graduate School of Information Science and Technology, Sapporo, Hokkaido 060-0814, Japan.

Physical Review. E
|February 20, 2026
PubMed
Summary
This summary is machine-generated.

Researchers demonstrate a phase transition in a novel language model, inspired by physics. This finding suggests natural language critical properties may stem from Berezinskii-Kosterlitz-Thouless (BKT) phases, not just fine-tuning.

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Related Experiment Videos

Last Updated: Jul 10, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Area of Science:

  • Statistical Physics
  • Computational Linguistics
  • Natural Language Processing

Background:

  • Power-law critical properties in natural languages resemble physical systems' phase transitions.
  • Large language models (LLMs) show similarities to physics concepts like scaling laws.
  • A gap exists in identifying generative language models exhibiting statistical physics-defined phase transitions.

Purpose of the Study:

  • To construct and analyze a probabilistic language model exhibiting a phase transition.
  • To investigate the applicability of statistical physics concepts to natural language modeling.
  • To explore the nature of critical properties in natural languages.

Main Methods:

  • Developed a context-sensitive random language model inspired by the 1D Potts model.
  • Numerically demonstrated an unambiguous phase transition by tuning a model parameter.
  • Defined and analyzed an order parameter capturing symbol frequency biases.

Main Results:

  • The order parameter transitioned from zero to non-zero in the infinite-length limit, indicating a singularity.
  • Identified the transition as a variant of the Berezinskii-Kosterlitz-Thouless (BKT) transition.
  • Observed BKT phase characteristics in a one-dimensional system, a rare phenomenon.

Conclusions:

  • Natural language critical properties might be generically explained by BKT phases.
  • This challenges the need for fine-tuning or self-organized criticality to explain language properties.
  • The study provides a rare example of a BKT phase in a 1D system, with implications for physics and linguistics.