A Method for Multimodal Information Extraction and Knowledge Graph Construction in Substation Secondary System

Multi-source heterogeneous data in substation secondary systems are typically characterized by high entropy and disorder, which pose significant challenges for cross-modal information integration and efficient retrieval. Therefore, a method for multimodal information extraction and knowledge graph construction is proposed, enabling structured processing of heterogeneous data from multiple sources. For the image modality, positional and semantic information is extracted using YOLOv8n and Optical Character Recognition (OCR) techniques. To mitigate the effects of uncertain connection topology and noise interference, a Heuristic Circular Stepping Search Algorithm (HCSA) is designed to achieve deterministic path tracing of information flows. For the text modality, a RoFormer-BiLSTM-CRF model enhanced with Rotary Position Embedding (RoPE) is developed to alleviate information degradation in long-sequence texts, thereby enabling high-accuracy extraction of entities and relationships. Furthermore, by combining the domain ontology mapping rules and string similarity, the extracted device entities from the two modalities are aligned, thereby converting scattered data into a structured knowledge graph. Experiments conducted on the secondary-side data of a substation in China demonstrate that the proposed method effectively extracts multimodal information from substation secondary systems, providing valuable support for information management and decision-making assistance in complex industrial systems.