ID-Guided Multimodal experts with contrastive diffusion for sequential recommendation
Yi-Hong Lu1, Wu-Dong Xi2, Xing-Xing Xing2
1School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China,.
Abstract:
Multimodal sequential recommendation enriches user-item interaction modeling by incorporating text and image modalities. However, existing methods often overlook the inherent inconsistencies between different modalities and fail to effectively filter redundant noise within modality-specific features, leading to suboptimal recommendation performance. To address these issues, we propose a novel framework named ID-Guided Multimodal Experts with Contrastive Diffusion for Sequential Recommendation (IMECD). Specifically, IMECD introduces a novel ID-guided multimodal mixture of experts module, which uniquely leverages long-term user preferences encoded in ID embeddings to dynamically guide the extraction of text and image features. This module helps resolve cross-modal semantic inconsistency and suppresses irrelevant signals, thereby improving the quality of multimodal representations. To further mitigate noise in user interaction sequences, we introduce a modality-specific vector quantization module that denoises sequential features by independently quantizing each modality. Moreover, we propose a contrastive diffusion generation module, which conditions the diffusion process on sequence representations and employs a contrastive loss to alleviate generation bias. Extensive experiments on four benchmark datasets demonstrate that IMECD consistently outperforms state-of-the-art baselines. Our code is available at https://anonymous.4open.science/r/IMECD-LYH.
More Related Videos
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
14:24Percutaneous Contrast Echocardiography-guided Intramyocardial Injection and Cell Delivery in a Large Preclinical Model
Published on: January 21, 2018
Related Concept Videos
Diffusion
Diffusion
Phase Contrast and Differential Interference Contrast Microscopy
In-phase-contrast microscopes, interference between light directly passing through a cell and light refracted by cellular components is used to create high-contrast, high-resolution images without staining. It is the oldest and simplest type of microscope that creates an image by altering the wavelengths of light rays passing through the specimen. Altered wavelength paths are created using an annular stop in the condenser. The annular stop produces a hollow cone of...
Facilitated Diffusion
In this process, substrates such as organic compounds and ions interact with a transporter on one side, triggering conformational changes in proteins that enable...
Behavior of Gas Molecules: Molecular Diffusion, Mean Free Path, and Effusion
Protein Diffusion in the Membrane
