Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

VisHikers' Guide to Evaluation: Competing Considerations in Study Design.

Emily Wall, Cindy Xiong, Yea-Seul Kim

    IEEE Computer Graphics and Applications
    |June 7, 2022
    PubMed
    Summary

    This viewpoint discusses the challenges in visualization evaluation due to its interdisciplinary nature. Understanding diverse evaluation approaches is key for researchers to navigate community expectations.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Self-administered digital vaccination decision-aids in primary care: A pilot study of COVID-19 vaccination in Atlanta, GA.

    Digital health·2026
    Same author

    Ambient Analytics: Calm Technology for Immersive Visualization and Sensemaking.

    IEEE computer graphics and applications·2026
    Same author

    Targeting dopamine D2 receptors to alter fear extinction in adolescent rats.

    Behavioral neuroscience·2026
    Same author

    Quantum Computing and Visualization Research Challenges and Opportunities.

    IEEE computer graphics and applications·2026
    Same author

    Visualizing the Chain of Thought in Large Language Models.

    IEEE computer graphics and applications·2026
    Same author

    Understanding the Research-Practice Gap in Visualization Design Guidelines.

    IEEE transactions on visualization and computer graphics·2025

    Area of Science:

    • Visualization
    • Human-Computer Interaction
    • Cognitive Science
    • Computer Graphics

    Background:

    • Visualization is an interdisciplinary field drawing from cognitive science, computer graphics, and other areas.
    • This diverse origin leads to varied approaches and expectations regarding evaluation methods within the visualization community.
    • Lack of a unified evaluation framework creates persistent tensions and challenges for researchers.

    Purpose of the Study:

    • To explicate the differing expectations and conventions in visualization evaluation.
    • To highlight the spectrum of evaluation design decisions.
    • To provide guiding questions for researchers navigating reader expectations in evaluation design.

    Main Methods:

    • Viewpoint article presenting a discussion of existing challenges.

    Related Experiment Videos

  • Analysis of the interdisciplinary nature of visualization and its impact on evaluation.
  • Identification of differing perspectives on evaluation within the research community.

    • Main Results:

    • Persistent tensions exist regarding the 'right' way to conduct evaluations in visualization.
    • Diverse perspectives, while fostering innovation, have not yet resolved differing evaluation conventions.
    • A spectrum of evaluation design decisions exists, influenced by disciplinary backgrounds.

    Conclusions:

    • Appreciating diverse perspectives on evaluation is crucial for the visualization field.
    • Researchers need to consider differing reader expectations when designing evaluations.
    • Developing a shared understanding of evaluation practices can foster collaboration and innovation.