Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Should medical teachers spend more time modelling or coaching students? A dual eye-tracking and randomised controlled study on peer instruction in sonography.

Medical education·2025
Same author

Looking at Social Interactions in Medical Education with Dual Eye-Tracking Technology: A Scoping Review.

MedEdPublish (2016)·2025
Same author

How Can High-Frequency Sensors Capture Collaboration? A Review of the Empirical Links between Multimodal Metrics and Collaborative Constructs.

Sensors (Basel, Switzerland)·2021
See all related articles

Related Experiment Video

Updated: Oct 5, 2025

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.6K

Augmenting Social Science Research with Multimodal Data Collection: The EZ-MMLA Toolkit.

Bertrand Schneider1, Javaria Hassan1, Gahyun Sung1

  • 1Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA.

Sensors (Basel, Switzerland)
|January 22, 2022
PubMed
Summary

EZ-MMLA is a new, browser-based toolkit for collecting multimodal sensing data, simplifying human behavior research. It offers easy access to various data streams without needing programming skills or special hardware.

Keywords:
computer visiondata miningsensor applications and deployments

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

718
Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection
08:08

Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection

Published on: May 31, 2024

1.1K

Related Experiment Videos

Last Updated: Oct 5, 2025

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.6K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

718
Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection
08:08

Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection

Published on: May 31, 2024

1.1K

Area of Science:

  • Social Sciences
  • Human-Computer Interaction
  • Behavioral Research

Background:

  • Traditional social science research relies on methods like surveys and observations.
  • Multimodal sensing offers high-frequency data to enrich behavioral, cognitive, and affective measurements.
  • Existing multimodal data collection methods often require specialized hardware and programming expertise.

Purpose of the Study:

  • To introduce the EZ-MMLA toolkit, a user-friendly, web-based platform for multimodal data collection.
  • To provide an accessible tool for researchers to capture diverse human behavior data streams.
  • To demonstrate the utility of EZ-MMLA in a practical research setting.

Main Methods:

  • Development of the EZ-MMLA toolkit as a website accessible via any browser.
  • Integration of algorithms for collecting various data modalities: eye-tracking, physiological signals (heart rate), skeletal data, hand gestures, facial expressions, speech, and computer vision tracking.
  • Comparison of EZ-MMLA with traditional research instruments.

Main Results:

  • The EZ-MMLA toolkit enables easy collection of multimodal data, including attention, physiological states, posture, gestures, emotions, and visual tracking.
  • The toolkit requires no dedicated hardware or programming experience, making it broadly accessible.
  • A case study demonstrated its successful application by educational researchers in a classroom.

Conclusions:

  • EZ-MMLA significantly lowers the barrier to entry for multimodal sensing in social science research.
  • The toolkit has potential applications across various fields, with ongoing work to explore its full capabilities and limitations.
  • Future research will focus on expanding functionalities and addressing implications for behavioral data collection.