Related Experiment Video
Updated: Jun 8, 2025
06:25
Time Multiplexing Super Resolving Technique for Imaging from a Moving Platform
Published on: February 12, 2014
8.4K
Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation
Jun-Tian Ye1,2,3, Yi Sun1,2,3, Wenwen Li1,2,3
1Hefei National Research Center for Physical Sciences at the Microscale and School of Physical Sciences, University of Science and Technology of China, Hefei, China.
Nature Computational Science
|November 6, 2024
Summary
This study introduces a new framework for non-line-of-sight (NLOS) imaging, enabling real-time video capture of hidden objects in complex scenes. The method uses spectrum filtering and motion compensation for high-quality, dynamic NLOS video.
Area of Science:
- Optics and Photonics
- Computer Vision
- Signal Processing
Background:
- Non-line-of-sight (NLOS) imaging recovers hidden object details.
- Real-time video of dynamic scenes is challenging due to weak multiply scattered light.
Purpose of the Study:
- To develop a framework for high-quality, real-time NLOS video in room-sized environments.
- To overcome limitations of weak signals and dynamic scene complexity in NLOS imaging.
Main Methods:
- A novel framework combining spectrum filtering and motion compensation.
- Spectrum filtering uses a wave-based model for frequency-domain denoising and deblurring.
- Motion compensation with interleaved scanning enables live video from low-quality sequences.
Main Results:
- Demonstrated high-quality NLOS video at 4 frames per second (fps).
- Successfully captured diverse, dynamic real-life scenes.
- Achieved computational image reconstruction with minimal sampling points.
Conclusions:
- The framework represents a significant advancement in real-time, large-scale NLOS imaging.
- Enables practical applications in low-power NLOS imaging and sensing.
- Paves the way for future developments in hidden object recovery.
Related Concept Videos
01:10Reconstruction of Signal using Interpolation
175
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
175
01:18Aliasing
119
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
119