Related Experiment Video
Updated: Aug 14, 2026

Real-World M3-BREATHE: Toward Multimodal Mobile Monitoring of Behaviour, Respiration, and Exposures for Treatment and Health Evaluation
Published on: June 5, 2026
An Agentic Multimodal Sensing Architecture for CT-Guided Wearable and Respiratory Monitoring in Oncology Care
Denisa-Daniela Frimu-Pascu1, Ciprian Dobre1,2,3, Mihai Olteanu4
1Faculty of Automatic Control and Computer Science, National University of Science and Technology Politehnica Bucharest, 060042 Bucharest, Romania.
None:
Oncology care increasingly depends on heterogeneous sensing streams generated by computed tomography (CT), radiotherapy planning systems, wearable devices, home respiratory sensors, patient-reported outcomes, and clinical records. These data streams are often processed separately, limiting their value for longitudinal, context-aware review. This study proposes OncoSense-Agent, a reliability-aware agentic multimodal sensing architecture for CT-guided respiratory monitoring in oncology care. The architecture links CT-derived anatomical evidence with wearable physiology, respiratory symptoms, functional assessment, treatment context, and explainable human-in-the-loop review-priority generation. To move beyond a purely conceptual design, we implemented a lung-focused proof-of-concept with six bounded software agents: Imaging Reliability, Wearable Monitoring, Respiratory Review, Treatment Context, Multimodal Fusion, and Explainability. The prototype used real nnU-Net v2 3D lung segmentation metrics from 139 patients with complete bilateral lung CT data as the imaging anchor, while wearable, respiratory, symptom, and treatment-context channels were introduced as deterministic overlays for controlled validation. OncoSense-Agent changed review-priority assignment relative to CT-only assessment in 78/139 cases (56.1%), assigned 111/139 cases (79.9%) to high-priority or high-uncertainty tiers, and showed increasing Safety Gate activation as CT quality declined. Three illustrative cases demonstrate hidden respiratory deterioration, wearable data-quality uncertainty, and treatment-context risk not captured by CT-only assessment. The prototype does not establish clinical diagnostic accuracy, but demonstrates operational, auditable, reliability-aware multimodal review-priority generation for clinician-supervised oncology monitoring.
More Related Videos
14:28Non-Invasive Monitoring of Microvascular Oxygenation and Reactive Hyperemia using Hybrid, Near-Infrared Diffuse Optical Spectroscopy for Critical Care
Published on: May 10, 2024
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
Related Concept Videos
Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
Pulse rhythm
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac muscle...