Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Vision

Vision

Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

<b>Erratum: KAI WANG, FU SHU, LING LI, WEN-JIE DONG, HAO-NAN MU, MING SU, WEN-BO ZHU, MENG-FEI ZHANG, KE-JI GUO & JING CHE (2025) A New Cryptic Species of <i>Calotes</i> (Reptilia: Squamata: Agamidae) from Southeastern Xizang Autonomous Region, China. <i>Zootaxa</i>, 5609 (2), 275-285.</b>

Zootaxa·2026

Same author

Sexual differences of temporal marking and communication behaviours of common leopards (Panthera pardus) in Luolong County, Tibet.

BMC ecology and evolution·2026

Same author

[Retracted] Tripterygium glycoside suppresses epithelial‑to‑-- mesenchymal transition of diabetic kidney disease podocytes by targeting autophagy through the mTOR/Twist1 pathway.

Molecular medicine reports·2026

Same author

Unraveling Mammalian Biodiversity in a Non-Protected Area in Tibet: Community Diversity, Species Interactions and Conservation Imperatives.

Biology·2026

Same author

CRISPR/Cas9-mediated disruption of Cmpks1 reveals its role as a key regulator of carotenoid biosynthesis and metabolic adaptation in Cordyceps militaris.

International journal of biological macromolecules·2026

Same author

Molecular characterization and functional analysis of dopamine receptor D4b in the large yellow croaker (Larimichthys crocea).

Comparative biochemistry and physiology. Part B, Biochemistry & molecular biology·2026

Search research articles

Related Experiment Video

Updated: May 1, 2026

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

M3AE-Distill: An Efficient Distilled Model for Medical Vision-Language Downstream Tasks.

Xudong Liang¹, Jiang Xie¹, Mengfei Zhang¹

¹School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China.

Bioengineering (Basel, Switzerland)

|July 29, 2025

Summary

This summary is machine-generated.

This study introduces M3AE-Distill, a lightweight medical vision-language model that uses knowledge distillation for efficient pre-training. It achieves high performance comparable to larger models while significantly speeding up inference and fine-tuning.

Keywords:

deep learning knowledge distillation pre-training vision–language

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Related Experiment Videos

Last Updated: May 1, 2026

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Area of Science:

Artificial Intelligence
Medical Informatics
Computer Vision

Background:

Multi-modal masked autoencoders (M3AE) are powerful medical vision-language (VL) models but suffer from large parameter sizes, hindering clinical deployment.
Knowledge distillation (KD) effectively compresses uni-modal models, but its application to pre-training medical VL backbone models is not well-established.

Purpose of the Study:

To develop M3AE-Distill, a lightweight medical VL model that maintains high performance while improving efficiency through knowledge distillation.
To address the deployment challenges of large M3AE models in real-world clinical settings.

Main Methods:

Employed hidden state and attention map distillation to guide the student model during pre-training.
Introduced an attention-guided masking strategy to improve fine-grained image-text alignment.
Developed two student variants, M3AE-Distill-Small and M3AE-Distill-Base, for flexible accuracy-efficiency trade-offs.

Main Results:

M3AE-Distill demonstrated effectiveness across five medical VL datasets and three tasks.
M3AE-Distill-Base achieved performance comparable to the teacher model.
Achieved significant speedups: 2.11× during inference and 2.61× during fine-tuning.

Conclusions:

M3AE-Distill offers an efficient and high-performing solution for medical vision-language tasks.
The proposed distillation and masking strategies enhance model efficiency without sacrificing accuracy.
The model variants provide practical options for deploying efficient medical VL systems.