PhotoCloud: Interactive remote exploration of joint 2D and 3D datasets

Area of Science:

• Computer Graphics
• Data Visualization
• Human-Computer Interaction

Background:

• Interactive visualization of large-scale 3D scene data, combining 2D photographs and 3D models, presents significant computational challenges.
• Existing systems often lack flexibility and are tied to specific data acquisition pipelines, limiting their applicability.

Purpose of the Study:

• To introduce PhotoCloud, a novel real-time client-server system designed for the interactive visualization and exploration of large datasets containing calibrated 2D photographs and 3D scene descriptions.
• To develop a flexible and scalable system that supports general data acquisition processes and facilitates seamless user navigation between 2D and 3D representations.

Main Methods:

• Implementation of a client-server architecture for remote data storage and access.
• Development of a multiresolution dynamic hierarchical data representation for scalability.
• Integration of an efficient client-side cache system, a compact image browser, and a multiresolution model renderer.
• Utilizing iconic visualization and on-the-fly image projection onto the 3D scene for enhanced exploration.

Main Results:

• PhotoCloud demonstrates real-time performance in visualizing and exploring large, complex datasets of 2D photographs and 3D models.
• The system provides smooth, integrated, and seamless transitions between 2D and 3D navigation spaces.
• A user study with participants of varying skill levels confirmed the system's effectiveness and powerful communication capabilities.

Conclusions:

• PhotoCloud offers a scalable, flexible, and effective solution for interactive exploration of large-scale 2D and 3D scene datasets.
• The system's ability to integrate and seamlessly transition between 2D and 3D visualization enhances user understanding and interaction.
• The demonstrated effectiveness suggests PhotoCloud's potential for various applications requiring complex data visualization.