Language Model Embedding Classifiers Enable Identification of Multiple Sclerosis-Associated BCRs and Repertoires

Multiple sclerosis (MS) is a chronic inflammatory demyelinating disease. It affects over 2 million people worldwide but has historically been challenging to diagnose, categorize, and treat. MS has an autoimmune component that involves the production of B-cell receptors (BCRs) and immunoglobulins (Igs) that are associated with disease pathophysiology. We reanalyzed all publicly available RNA sequencing data from MS patients and extracted over 11 million BCR immunoglobulin heavy chain (IGH) sequences obtained from a variety of tissue sources. We developed a new decoder-only BCR DNA embedding model that outperforms state-of-the-art BCR and general-purpose protein language models on sequence embedding tasks. We then trained a language model classifier capable of identifying BCR sequences associated with MS. Using low-dimensional representations of whole repertoire embeddings combined with sequence-disease predictions, we can distinguish MS patient repertoires from healthy, infectious disease, or other autoimmune disease repertoires. Our models also successfully rank known MS-associated myelin-binding IgG sequences relative to controls. These findings provide a methodological foundation for BCR-based MS detection and could facilitate identification and study of disease-associated antibodies from blood.