Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Optimal Foraging

Optimal Foraging

How animals obtain and eat their food is called foraging behavior. Foraging can include searching for plants and hunting for prey and depends on the species and environment.

Biodiversity and Human Values

Biodiversity and Human Values

Human civilization relies on biodiversity in many ways. Sudden changes in species biodiversity result in environmental changes that can modify weather patterns and therefore human civilizations.

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The Physical Activity Assessment Using Wearable Sensors (PAAWS) Dataset: Labeled Laboratory and Free-living Accelerometer Data.

Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies·2026

Same author

Collecting Self-reported Physical Activity and Posture Data Using Audio-based Ecological Momentary Assessment.

Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies·2025

Same author

Within- and Between-Individual Compliance in Mobile Health: Joint Modeling Approach to Nonrandom Missingness in an Intensive Longitudinal Observational Study.

JMIR mHealth and uHealth·2025

Same author

Understanding Longitudinal Ecological Momentary Assessment Completion: Results From 12 Months of Burst Sampling in the TIME Study.

JMIR mHealth and uHealth·2025

Same author

Ask Less, Learn More: Adapting Ecological Momentary Assessment Survey Length by Modeling Question-Answer Information Gain.

Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies·2024

Same author

Burden and Inattentive Responding in a 12-Month Intensive Longitudinal Study: Interview Study Among Young Adults.

JMIR formative research·2024

See all related articles

Search research articles

Related Experiment Video

Updated: Jun 19, 2026

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

Towards Practical, Best Practice Video Annotation to Support Human Activity Recognition.

Hoan Tran¹, Veronika Potter¹, Umberto Mazzucchelli¹

¹Northeastern University, Boston, MA 02115, USA.

Annotation of Real-World Data for Artificial Intelligence Systems : 9Th International Workshop, ARDUOUS 2025, Bologna Italy, October 25-26, 2025, Proceedings. International Workshop on Annotation of Real-World Data for Artificial Intell

|January 15, 2026

Summary

This summary is machine-generated.

A new "silver-standard" annotation method for wearable sensor data saves 33% of annotation time compared to the gold-standard. This revised annotation approach maintains high accuracy for activity recognition model training and evaluation.

Keywords:

Annotation Human Activity Recognition Taxonomy Video

More Related Videos

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Jun 19, 2026

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Area of Science:

Biomedical Engineering
Human-Computer Interaction
Wearable Technology

Background:

Accurate ground-truth annotations are crucial for training and evaluating wearable-sensor-based activity recognition models.
Traditional
gold-standard
annotation involves two independent annotators and a third expert, which is time-consuming.
Increasing demand for complex, 24/7, and granular activity data challenges existing annotation methods.

Purpose of the Study:

To investigate a more efficient
silver-standard
annotation approach for wearable sensor data.
To compare the efficiency and accuracy of the silver-standard method against the gold-standard and single-annotator methods.

Main Methods:

The
silver-standard
method involves a second annotator revising the work of the first, instead of independent double annotation.
Annotation quality and time efficiency were compared against the gold-standard (two independent annotators + expert resolution) and single-annotator methods.
Inter-rater reliability was assessed using Cohen's kappa (κ).

Main Results:

The silver-standard approach reduced total annotation time by 33% compared to the gold-standard.
Silver-standard labels showed higher agreement with the gold-standard (κ=0.77) than single-annotator labels (κ=0.68) over 16.4 hours of video.
Mean inter-rater reliability for silver-standard labels (κ=0.79) was higher than for single-annotator labels (κ=0.68) across 92 hours of footage.

Conclusions:

The silver-standard annotation method offers a practical and efficient alternative for generating high-quality ground-truth data for activity recognition.
This approach balances annotation efficiency with near-equivalent quality to the gold-standard, making it suitable for large-scale and complex datasets.
The silver-standard method improves upon single-annotator reliability and is a viable option for researchers developing wearable sensor-based activity recognition models.