Related Experiment Video
Updated: May 9, 2026

Video Movement Analysis Using Smartphones (ViMAS): A Pilot Study
Published on: March 14, 2017
A multi-view machine learning approach for estimating PM2.5 concentrations from smartphone photographs
Jianzheng Liu1, Zurong Zheng2, Fei Yao3
1School of Public Affairs, Xiamen University, Xiamen, Fujian 361005, China; Fujian Key Laboratory of Urban Intelligent Sensing and Computing, Xiamen, Fujian 361005, China; Xiamen Key Laboratory of Integrated Application of Intelligent Technology for Architectural Heritage Protection, Xiamen, Fujian 361005, China.
Estimating fine particulate matter (PM2.5) using multi-view smartphone photos and advanced machine learning significantly improves accuracy. This approach provides personalized air quality data, enhancing public health awareness and risk reduction.
Area of Science:
- Environmental Science
- Computer Science
- Public Health
Background:
- Estimating fine particulate matter (PM2.5) concentrations from smartphone photographs offers personalized public health risk information.
- Existing methods using single-view photos suffer from spatiotemporal mismatches, introducing bias.
- There is a need for more accurate and reliable PM2.5 estimation techniques using readily available technology.
Purpose of the Study:
- To develop and validate a novel method for estimating PM2.5 concentrations using multi-view smartphone photographs.
- To construct a rigorously spatiotemporally registered benchmark dataset for PM2.5 measurements and multi-view smartphone images.
- To improve the accuracy of PM2.5 exposure assessment by leveraging semantic image features and advanced machine learning.
Main Methods:
- A benchmark dataset of PM2.5 measurements and multi-view smartphone photographs was created for Hebei and Fujian provinces (2022-2024).
- The XGBoost model was employed to correlate PM2.5 measurements with image features extracted from segmented regions (vegetation, sky).
- Image features, including color and local binary patterns from specific regions, were analyzed for predictive power.
Main Results:
- The proposed multi-view approach achieved high accuracy, with R² values of 0.96 (Hebei) and 0.89 (Fujian).
- Root Mean Square Error (RMSE) values were 6.82 μg/m³ (Hebei) and 3.63 μg/m³ (Fujian), outperforming single-view methods.
- Image color from vegetation and color/local binary patterns from sky regions were identified as key predictive features.
Conclusions:
- Multi-view smartphone photographs combined with machine learning offer a superior method for estimating PM2.5 concentrations.
- The rigorously registered dataset and focus on semantic image features enable more reliable air quality monitoring.
- This approach has the potential to significantly enhance public awareness of environmental risks and reduce associated health impacts.

