A spatially augmented reality sketching interface for architectural daylighting design
Related Experiment Video
Updated: Jun 6, 2026

Photorealistic Learned Landscapes for Augmented Reality
Published on: June 27, 2025
Yu Sheng1, Theodore C Yapo, Christopher Young
1Computer Science Department, Rensselaer Polytechnic Institute, 110 8th Street, Lally 207, Troy, NY 12180-3590, USA. shengyu@cs.rpi.edu
Abstract:
We present an application of interactive global illumination and spatially augmented reality to architectural daylight modeling that allows designers to explore alternative designs and new technologies for improving the sustainability of their buildings. Images of a model in the real world, captured by a camera above the scene, are processed to construct a virtual 3D model. To achieve interactive rendering rates, we use a hybrid rendering technique, leveraging radiosity to simulate the interreflectance between diffuse patches and shadow volumes to generate per-pixel direct illumination. The rendered images are then projected on the real model by four calibrated projectors to help users study the daylighting illumination. The virtual heliodon is a physical design environment in which multiple designers, a designer and a client, or a teacher and students can gather to experience animated visualizations of the natural illumination within a proposed design by controlling the time of day, season, and climate. Furthermore, participants may interactively redesign the geometry and materials of the space by manipulating physical design elements and see the updated lighting simulation.
Related Concept Videos
Design Example: Dimensioning of Concrete Masonry Construction
The site engineer has laid out a plan for the storeroom with external dimensions of twelve feet in length and eight feet...
Masonry Curtain Walls
Design Example: Sustainability in Concrete Building
There are multiple approaches to achieve sustainability in a commercial concrete building. For instance, construct a concrete parking area under the building, utilizing pervious concrete paver blocks in open areas to facilitate rainwater collection through an underground cistern.
Design Example: Designing a Residential Plumbing System
Curve Sketching and Derivatives
Design Example: Design of an Irrigation Channel