Multimodal Fusion Inference for Power Trading Data Using Natural Language Queries and Explainable Analytics

This research aims to design an innovative multimodal fusion inference technique for analyzing big data in power trading, enabling the transformation of natural language-based queries into structured analysis and the automation of chart creation. The previous state-of-the-art multimodal predictive models have shortcomings in handling natural-language-based reasoning, visualization, and heterogeneous power-trading scenarios. A framework for multimodal inference for power trading is proposed, which brings together natural language dialogue, market intelligence, and explainable analytics. The key scientific innovation is the provision of unified multimodal reasoning that will help convert natural language questions into analytical insights and visual decision aids for large-scale power trading systems. To resolve such limitations, the current multimodal framework uses federated market-sensor transformer (FMST) and European network of transmission system operators for electricity (ENTSO-E) electricity market datasets for creating an integrated multimodal power trading scenario using time series, market information, financial news, power grid details, and past trading trends. The experimental evaluation was carried out on large FMST and ENTSO-E data sets, which consisted of records from financial markets, electricity trading, and grid operations, and compared with the autoregressive integrated moving average (ARIMA), long short-term memory (LSTM), gated recurrent unit (GRU), iTransformer, temporal fusion transformer (TFT), building information modeling coder (BIMCoder), multimodal-bidirectional encoder representations from transformers (BERT), and federated averaging (FedAvg) models. It was observed that the proposed framework provided excellent results in root mean squared error (RMSE) and mean absolute error (MAE), R² prediction accuracy, interpretation accuracy of queries, multimodal fusion efficiency, and generation of charts accuracy.