Related Experiment Video
Updated: Jun 2, 2025

Analyzing Mitochondrial Morphology Through Simulation Supervised Learning
Published on: March 3, 2023
Simulating 500 million years of evolution with a language model
Thomas Hayes1, Roshan Rao1, Halil Akin1
1EvolutionaryScale, PBC, New York, NY, USA.
None:
More than 3 billion years of evolution have produced an image of biology encoded into the space of natural proteins. Here, we show that language models trained at scale on evolutionary data can generate functional proteins that are far away from known proteins. We present ESM3, a frontier multimodal generative language model that reasons over the sequence, structure, and function of proteins. ESM3 can follow complex prompts combining its modalities and is highly responsive to alignment to improve its fidelity. We have prompted ESM3 to generate fluorescent proteins. Among the generations that we synthesized, we found a bright fluorescent protein at a far distance (58% sequence identity) from known fluorescent proteins, which we estimate is equivalent to simulating 500 million years of evolution.
Related Concept Videos
Per-Unit Sequence Models
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Modeling and Similitude
Gene Evolution - Fast or Slow?
Mutation, Gene Flow, and Genetic Drift
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Typical Model Studies

