Related Experiment Video
Updated: Jan 9, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Large Language Models for Efficient Mental Health Parity Oversight
1Kennedy Forum, Brigantine, NJ.
Objective:
The author examined whether a large language model (LLM) can help identify noncompliance with the Mental Health Parity and Addiction Equity Act (MHPAEA) in health insurance plan documents.
Methods:
Using Anthropic's Claude 3.5 Sonnet between December 1, 2024, and January 31, 2025, the author analyzed primary documentation for the Essential Health Benefits benchmark plans for 2026. An LLM prompt was first validated, and the author assessed the LLM's positive predictive value (PPV) in applying that prompt to identify areas of potential MHPAEA noncompliance. The LLM then prioritized the top 10 areas of noncompliance among those accurately identified.
Results:
The LLM identified on average 3.8 areas of potential noncompliance per document, with an average PPV of 49%.
Conclusions:
The findings indicate that LLMs currently have a relatively poor PPV in regulatory oversight tasks but may help improve efficiency by enabling rapid identification of potential MHPAEA noncompliance to prioritize areas for further review.
More Related Videos
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
Related Concept Videos
Models of Health Promotion and Illness Prevention I
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
Standards of Care I
Community Based Intervention
Foundations of Community Mental Health Programs
Central to the success of community-based interventions is the...
Modeling in Therapy
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Standards of Care II