Related Experiment Video
Updated: Aug 29, 2026

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
Published on: November 24, 2015
Visual Embodied Brain-1.5: Enhanced Perception, Spatial Reasoning and Robot Control in Spaces
Abstract:
The remarkable progress of Multimodal Large Language Models (MLLMs) has attracted increasing attention to extending them to physical entities like legged robots and robotic arms. This typically requires MLLMs to not only grasp multimodal understanding abilities, but also integrate visual-spatial reasoning and physical interaction capabilities. Nevertheless, existing methods struggle to jointly accommodate these capabilities within a shared multimodal model, due to the substantial differences between vision-language reasoning and low-level physical control. In this paper, we present Visual Embodied Brain-1.5 (VeBrain-1.5), a task-level unified framework that connects multimodal perception and spatial reasoning with robot control through a shared MLLM-compatible decision interface. VeBrain-1.5 reformulates robotic control into common text-based MLLM tasks in the 2D visual space, thereby aligning the supervision format and prediction interface of multimodal understanding, spatial reasoning, and robot control. A modular robotic adapter subsequently translates these high-level textual decisions into embodiment-specific motion commands and executes them in a closed loop. From the data perspective, we further introduce VeBrain-1M, a high-quality instruction dataset encompassing various capabilities of VeBrain-1.5. In VeBrain-1M, we take hundreds of hours to collect, curate and annotate the data, and adopt multimodal chain-of-thought (CoT) to mix the different capabilities into a single conversation. Extensive experiments on 13 multimodal benchmarks, 7 spatial intelligence benchmarks and 4 simulation and real-world robotic benchmarks demonstrate the superior performance of VeBrain-1.5 over existing MLLMs like Qwen2.5-VL. To further eliminate the task ambiguity and enhance the reasoning capability, we adopt an offline RL policy learning with verifiable reward to increase the task success rate. When deployed to two robotic entities including legged robots and robotic arms, VeBrain-1.5 shows strong adaptability, flexibility, and compositional capabilities compared to existing methods.
Related Concept Videos
Parallel Processing
Sensory Perception: Organization of the Somatosensory System
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
Perception
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Depth Perception and Spatial Vision

