Related Experiment Video
Updated: Sep 20, 2026

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities
Published on: October 27, 2023
Comorbidity-Aware Radiology Report Generation
Abstract:
Chest X-ray report generation systems are valuable for assisting disease diagnosis and improving healthcare efficiency. However, existing methods still face two key challenges. First, multiple diseases often co-occur, leading to a combinatorial explosion of label combinations and sparse supervision for learning a generalizable image-to-label mapping. Second, standard autoregressive training is primarily optimized for local linguistic fluency, but provides limited direct supervision for global clinical fidelity, often resulting in omissions or contradictions in complex multi-abnormality cases. To address these issues, we introduce a geometry-aware multimodal large-model framework. The framework leverages hyperbolic geometry as a hierarchy-aware inductive bias and applies hierarchy-consistent constraints at three levels: representation, loss, and reinforcement signals. Specifically, we build a hyperbolic contrastive language-image pre-training (CLIP) model to align image-text semantics; estimate class prototypes from single-label cases and perform prototype-driven hyperbolic contrastive learning to enforce radius ordering for multi-label samples; and incorporate a learnable hyperbolic soft reward into the group relative policy optimization (GRPO) framework to directly optimize clinical accuracy. On the MIMIC-CXR benchmark, HyCoRG obtains BLEU-4 of 0.136 as well as clinical F1 of 0.515, indicating improved disease-level clinical consistency. Ablation studies confirm that both the framework and the geometric constraints contribute independently and synergistically. Our approach improves both linguistic quality and diagnostic fidelity, and offers a transferable hierarchy-aware paradigm for multi-label medical text generation. The code is publicly available at https://github.com/hongzezhu/HyCoRG.
More Related Videos
Related Concept Videos
Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Positron Emission Tomography
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body being...
Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
Imaging Studies II: Positron Emission Tomography and Scintigraphy
Fundamental Principles of PET
Imaging Studies for Cardiovascular System V: CT

