Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Halo Effect01:27

Halo Effect

44
The halo effect is a cognitive bias in which an individual's overall impression influences judgments about their specific traits. This psychological phenomenon leads people to associate positive characteristics with those they perceive as generally good and negative characteristics with those they view as bad. This effect is particularly influential in social perception, professional evaluations, and decision-making processes.The Psychological Basis of the Halo EffectThe halo effect is rooted...
44
Stereotype Content Model02:16

Stereotype Content Model

14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K
Impression Management Techniques III: Aligning Actions01:29

Impression Management Techniques III: Aligning Actions

25
Aligning actions are communicative strategies individuals employ to maintain social harmony and preserve personal identity in the face of potential disruptions to social norms. These actions are particularly important in managing social impressions when one's behavior might be seen as inappropriate, incompetent, or morally questionable.Types of Aligning ActionsThe three principal types of aligning actions are disclaimers, accounts, and apologies.DisclaimersDisclaimers are preventive; they are...
25

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Opportunities and Challenges for the Federally Qualified Health Center Program: A Critical Review.

Annual review of public health·2025
Same author

The Promise and Challenge of Large Language Models for Pharmacovigilance.

Drug safety·2025
Same author

Cardiovascular equity and health center funding: Associations of unmet hypertension and diabetes need by race/ethnicity and federal grants at federally qualified health centers, 2014-2019.

PloS one·2024
Same author

Association of Food Insecurity with Changes in Diet Quality, Weight, and Glycemia Over Two Years in Adults with Prediabetes and Type 2 Diabetes on Medicaid.

Research square·2023
Same author

Overview of the COVID-19 text mining tool interactive demonstration track in BioCreative VII.

Database : the journal of biological databases and curation·2022
Same author

An Overview of Cancer in the First 315,000 All of Us Participants.

PloS one·2022
Same journal

Logic, inference, understanding: cross-domain generalization for generative language models.

Frontiers in artificial intelligence·2026
Same journal

Label tree semantic losses for rich multi-class medical image segmentation.

Frontiers in artificial intelligence·2026
Same journal

Score-based generative diffusion models to synthesize full-dose FDG brain PET from MRI in epilepsy patients.

Frontiers in artificial intelligence·2026
Same journal

Resource-efficient retrieval-augmented question answering for the Indian Lok Sabha dataset.

Frontiers in artificial intelligence·2026
Same journal

Violation detection in power operation sites based on multi-scale detection and few-shot learning.

Frontiers in artificial intelligence·2026
Same journal

Deep reinforcement learning-based reversible medical image encryption framework for secure IoMT environments.

Frontiers in artificial intelligence·2026
See all related articles

Related Experiment Video

Updated: Oct 14, 2025

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

7.8K

Assessing Open-Ended Human-Computer Collaboration Systems: Applying a Hallmarks Approach.

Robyn Kozierok1, John Aberdeen1, Cheryl Clark1

  • 1The MITRE Corporation, Bedford, MA, United States.

Frontiers in Artificial Intelligence
|November 5, 2021
PubMed
Summary
This summary is machine-generated.

New evaluation criteria, the Hallmarks of Human-Machine Collaboration, are introduced for computer systems working on complex tasks with people. These criteria assess systems for robustness, creativity, and effective teamwork, guiding development for better human-AI partnerships.

Keywords:
assessmentcollaborative assistantsdialogueevaluationhuman-machine teamingmultimodal

More Related Videos

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.4K
Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems
08:42

Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems

Published on: May 5, 2015

12.3K

Related Experiment Videos

Last Updated: Oct 14, 2025

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

7.8K
Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.4K
Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems
08:42

Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems

Published on: May 5, 2015

12.3K

Area of Science:

  • Computer Science
  • Human-Computer Interaction
  • Artificial Intelligence

Background:

  • Complex, open-ended human-computer activities require new evaluation methods beyond traditional Q&A or task-oriented systems.
  • Existing evaluation techniques for spoken language and chatbots are insufficient for collaborative systems.
  • The DARPA Communicating with Computers (CwC) program aimed to develop AI systems as creative partners for humans.

Purpose of the Study:

  • To introduce a novel set of evaluation criteria, the Hallmarks of Human-Machine Collaboration, for assessing advanced human-AI collaborative systems.
  • To provide a framework for evaluating systems that engage in complex, multimodal, and creative tasks with human partners.
  • To guide the development and identify areas for improvement in human-machine collaboration.

Main Methods:

  • Developed the Hallmarks of Human-Machine Collaboration, building on heuristic and spoken language evaluation techniques.
  • Grouped criteria into eight properties: robustness, habitability, mutual contribution, context-awareness, engagement, rationale, concept learning, and successful collaboration.
  • Applied the Hallmarks to evaluate diverse CwC program activities like story/music generation and molecular mechanism exploration.

Main Results:

  • The Hallmarks were used as development guides and diagnostic tools to assess system strengths and weaknesses.
  • Evaluation methods included user study logs, partner surveys, third-party reviews, and direct testing.
  • Informal feedback indicated the Hallmarks effectively guided development and identified progress and gaps in AI collaboration.

Conclusions:

  • The Hallmarks of Human-Machine Collaboration provide a robust framework for evaluating AI systems designed for creative partnership with humans.
  • These criteria facilitate the identification of strengths and areas for improvement in developing AI as an equal collaborator.
  • The framework supports the advancement of AI systems capable of complex, open-ended collaboration with human users.