Related Experiment Video
Updated: Jun 21, 2026
11:29
Novel 3D/VR Interactive Environment for MD Simulations, Visualization and Analysis
Published on: December 18, 2014
TransCAIP: A Live 3D TV system using a camera array and an integral photography display with interactive control of
Yuichi Taguchi1, Takafumi Koike, Keita Takahashi
1Graduate School of Information Science and Technology, The University of Tokyo, Bunkyo-ku, Tokyo 113-8656, Japan. yuichi@hc.ic.i.u-ac.jp
IEEE Transactions on Visualization and Computer Graphics
|July 11, 2009
Summary
This study presents a real-time 3D visual system using 64 cameras and integral photography. It enables interactive control over dynamic 3D scenes, offering a novel autostereoscopic display experience.
Area of Science:
- Computer Vision
- Display Technology
- Image Processing
Background:
- Autostereoscopic displays offer immersive 3D experiences without glasses.
- Integral photography (IP) is a key technology for achieving full-parallax 3D.
- Real-time processing of multi-camera data for IP presents significant computational challenges.
Purpose of the Study:
- To develop a real-time system for generating integral photography images from multi-camera data.
- To enable interactive control of viewing parameters for dynamic 3D scene reproduction.
- To achieve a high-quality, full-color, full-parallax 3D visual experience.
Main Methods:
- Utilized an array of 64 video cameras to capture a live 3D scene.
- Developed an image-based rendering conversion method to transform multi-camera images into integral photography format.
- Implemented all conversion processes on a Graphics Processing Unit (GPU) using General-Purpose computing on Graphics Processing Units (GPGPU) techniques for real-time performance.
- Enabled interactive control via software adjustments of rendering parameters.
Main Results:
- Successfully reproduced a live 3D scene on an integral photography display with 60 viewing directions.
- Achieved real-time conversion and display of dynamic 3D content.
- Demonstrated interactive control over viewing parameters like convergence point and viewpoint interval without hardware changes.
Conclusions:
- The developed system provides a viable solution for real-time, interactive, autostereoscopic 3D visualization.
- Image-based rendering combined with GPGPU acceleration is effective for converting multi-camera data to integral photography format.
- The system offers flexible control over 3D display parameters, enhancing user experience for dynamic scenes.
