Related Experiment Videos
Multimodal machine learning for integrating heterogeneous analytical systems
Shun Muroga1,2, Hideaki Nakajima3, Taiyo Shimizu3
1Nano Carbon Material Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba Central 5, 1-1-1, Higashi, Tsukuba, Ibaraki, 305-8565, Japan. muroga-sh@aist.go.jp.
None:
Understanding structure-property relationships in complex materials requires integrating complementary measurements across multiple length scales. Here we propose an interpretable "multimodal" machine learning framework that unifies heterogeneous analytical systems for end-to-end characterization, demonstrated on carbon nanotube (CNT) films whose properties are highly sensitive to microstructural variations. Quantitative morphology descriptors are extracted from SEM images via binarization, skeletonization, and network analysis, capturing curvature, orientation, intersection density, and void geometry. These SEM-derived features are fused with Raman indicators of crystallinity/defect states, specific surface area from gas adsorption, and electrical surface resistivity. Multi-dimensional visualization using radar plots and UMAP reveals clear clustering of CNT films according to crystallinity and entanglements. Regression models trained on the multimodal feature set show that nonlinear approaches, particularly XGBoost, achieve the best predictive accuracy under leave-one-out cross-validation. Feature-importance analysis further provides physically meaningful interpretations: surface resistivity is primarily governed by junction-to-junction transport length scales, crystallinity/defect-related metrics, and network connectivity, whereas specific surface area is dominated by intersection density and void size. The proposed multimodal machine learning framework offers a proof-of-concept demonstration for data-driven and explainable characterization of complex materials using multimodal machine learning.
Related Concept Videos
Multi-input and Multi-variable systems
In the absence of...
Classification of Systems-I
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Mass Spectrometry: Complex Analysis
GC–MS is a powerful hyphenated method commonly used in forensics and environmental...
Classification of Systems-II