Virtual reality for animal navigation with camera-based optical flow tracking.

Area of Science:

• Neuroscience
• Computer Vision
• Behavioral Science

Background:

• Virtual reality (VR) with spherical treadmills aids in studying neural circuits for navigation and learning across species.
• Current methods often rely on optical mice for tracking treadmill motion.

Purpose of the Study:

• To develop and characterize a novel, fast optical flow-based system for tracking treadmill ball motion in real-time.
• To enable precise virtual reality behavioral experiments, particularly for small organisms like fruit flies.

Main Methods:

• A single high-resolution camera and optical flow algorithms were used for real-time tracking of treadmill ball motion.
• The system was integrated with an open-source game engine for VR projection, achieving high frame rates and low latency.
• Tracking accuracy and timing were validated using calibration data.

Main Results:

• The system achieved high-speed ball tracking at 500 Hz.
• Virtual reality projection was updated at 120 Hz with a low latency of 30 ± 8 ms.
• The system demonstrated successful application in behavioral studies with fruit flies.

Conclusions:

• A flexible and accurate camera-based optical flow tracking system for VR treadmill motion was successfully developed.
• This system provides an alternative to traditional optical mice, offering greater control over tracking parameters.
• The developed system is suitable for high-throughput behavioral analysis in virtual reality environments.