Integrated 3D display and imaging using dual purpose passive screen and head-mounted projectors and camera

Area of Science:

• Optics and Photonics
• Computer Vision
• Human-Computer Interaction

Background:

• Current 3D display and imaging systems often require separate devices.
• Head-mounted devices offer potential for immersive experiences but face integration challenges.

Purpose of the Study:

• To develop an integrated 3D display and imaging system using a head-mounted device and a dual-purpose passive screen.
• To enable simultaneous 3D display and image capture within a single system.

Main Methods:

• A novel passive screen composed of retro-reflective microspheres (for display) and curved mirrors (for imaging).
• Polarization multiplexing to separate display and imaging operations.
• A prototype system with pico-projectors, a camera, and a custom-designed screen.

Main Results:

• The system achieved bright 3D display (up to 240 cd/m²) with low crosstalk (<4%).
• Demonstrated real-time 3D image capture via computational reconstruction of stereo pairs.
• Evaluated capture quality using imaging Modulation Transfer Function (MTF) and light efficiency.

Conclusions:

• The integrated system successfully demonstrates simultaneous 3D display and imaging capabilities.
• The proposed technology offers a unique mobile platform for advanced immersive human-computer interaction.
• Further advancements in microfabrication and computational optics are expected to enhance system performance.