Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Brain Imaging01:14

Brain Imaging

1.0K
Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans),  magnetic resonance imaging (MRI),  functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
1.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Broad-linewidth sources result in a skin-tone bias in noninvasive optical measurement of oxygen saturation.

Journal of biomedical optics·2026
Same author

Optical characterization of turbid media in a cuvette geometry with a calibrated lookup table.

Applied optics·2026
Same author

Functional dual-slope frequency-domain near-infrared spectroscopy data interpreted with two- and three-layer models.

Biophotonics discovery·2026
Same author

Noninvasive measurements of skeletal muscle hemodynamics using frequency-domain near-infrared spectroscopy: contributions from adipose and bone tissues.

Biophotonics discovery·2026
Same author

Self-reported and task-based measures of attention control are distinct.

Behavior research methods·2026
Same author

Acoustic-Prosodic and Physiological Response to Stressful Interactions in Children with Autism Spectrum Disorder.

Interspeech·2026

Related Experiment Video

Updated: Apr 30, 2026

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.8K

A Multimodal Virtual Reality Data Acquisition Platform and Dataset to Assess Systemic Human Cognitive States.

Ayca Aygun1, Giles Blaney2, Zachary Haga1

  • 1Tufts University Department of Computer Science, Medford, MA 02155, US.

Scientific Data
|December 9, 2025
PubMed
Summary

Researchers developed a new method to monitor human cognitive states for better human-machine teaming. This multimodal dataset and experimental framework will advance AI

More Related Videos

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.9K
Virtual Reality Tools for Assessing Unilateral Spatial Neglect: A Novel Opportunity for Data Collection
07:04

Virtual Reality Tools for Assessing Unilateral Spatial Neglect: A Novel Opportunity for Data Collection

Published on: March 10, 2021

4.5K

Related Experiment Videos

Last Updated: Apr 30, 2026

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.8K
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.9K
Virtual Reality Tools for Assessing Unilateral Spatial Neglect: A Novel Opportunity for Data Collection
07:04

Virtual Reality Tools for Assessing Unilateral Spatial Neglect: A Novel Opportunity for Data Collection

Published on: March 10, 2021

4.5K

Area of Science:

  • Human-Computer Interaction
  • Cognitive Science
  • Neuroscience
  • Artificial Intelligence

Background:

  • Growing interest in human-machine teaming across diverse applications like search and rescue, space exploration, and agriculture.
  • Effective human-machine collaboration requires artificial agents to recognize and respond to human cognitive states (e.g., workload, urgency, distraction).
  • Existing methods lack comprehensive multimodal data for analyzing and predicting complex cognitive states in real-time.

Purpose of the Study:

  • Introduce a novel experimental paradigm and multimodal dataset for studying systematic human cognitive states.
  • Facilitate the development of robust prediction models for human cognitive states in interactive tasks.
  • Provide a framework for designing future experiments in human-machine interaction research.

Main Methods:

  • Developed an experimental setup for synchronized, real-time recording of multiple physiological data streams.
  • Utilized advanced sensing technologies: functional near-infrared spectroscopy (fNIRS), electroencephalography (EEG), pupillometry, respiration, electrodermal activity, and plethysmography.
  • Collected data from 80 participants performing a driving task with concurrent secondary tasks (braking, dialogue, tactile stimulation).

Main Results:

  • Acquired a comprehensive multimodal dataset capturing various human cognitive states during interactive tasks.
  • Demonstrated the capability of the experimental setup to integrate diverse physiological signals for cognitive state monitoring.
  • The dataset provides a rich resource for analyzing interrelationships between cognitive states and physiological responses.

Conclusions:

  • The introduced experimental paradigm and dataset are crucial for advancing research in human-machine teaming.
  • The framework enables the development of AI systems that are more responsive to human cognitive dynamics.
  • This work lays the foundation for creating more effective and adaptive human-AI collaborative systems.