相关实验视频

Updated: Sep 8, 2025

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

紧的视觉语言模型通过层特定的多模式学习实现高效和可解释的自动化OCT分析

Tania Haghighi¹, Sina Gholami¹, Jared Todd Sokol²

¹Department of Electrical and Computer Engineering, University of North Carolina at Charlotte, Charlotte, NC 28223, USA.

bioRxiv : the preprint server for biology

|August 20, 2025

概括

我们开发了LO-VLM, 一个高效的AI模型来解释OCT B扫描, 生成准确的临床叙述和分类视网膜疾病. 这种视觉语言模型在总结生成和诊断准确性方面显著优于现有方法.

科学领域:

眼科眼科
人工智能
医学成像

背景情况:

对视网膜疾病的光学一致性断层扫描 (OCT) 解释需要将视觉数据与医学知识相结合的AI.
现有的人工智能模型难以准确地将OCT成像特征转化为临床叙述.

研究的目的:

推出LO-VLM,这是一个新的,紧的视觉语言模型 (VLM),旨在用于OCTB扫描解释.
增强视网膜疾病的自由形式总结和多类疾病分类.

主要方法:

编制了4万个OCTB扫描的多式数据集,并对六种疾病进行了专家验证.
开发了LO-VLM,一个247M参数VLM,在其编码器和解码器中包含解剖学指导.
与RetinaVLM,LLaVA-Med和一个ViT模型进行比较.

主要成果:

与RetinaVLM (5.5/10) 相比,LO-VLM叙述得到了视网膜专家显著更高的分数 (8.5/10).
取得了优异的定量指标:SBERT相似度为0.803和BERTScore F1为0.715.
在疾病分类中达到96%的准确性,超过ViT的13%和医疗VLM的62%.

结论:

在海外国家和地区分析中,LO-VLM为有效和可解释的人工智能提供了一个新范式.
该模型在生成临床叙述和分类视网膜疾病方面表现出卓越的表现.
LO-VLM将计算效率与OCT解释的高准确性相结合.

更多相关视频

Constructing and Visualizing Models using Mime-based Machine-learning Framework

Constructing and Visualizing Models using Mime-based Machine-learning Framework

Published on: July 22, 2025

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Published on: December 8, 2023

相关概念视频

Multicompartment Models: Overview

Multicompartment Models: Overview

Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...