Promoting insight-based evaluation of visualizations: from contest to benchmark repository
Related Experiment Video
Updated: Jul 10, 2026

Facilitating the Analysis of Immunological Data with Visual Analytic Techniques
Published on: January 2, 2011
Catherine Plaisant1, Jean-Daniel Fekete, Georges Grinstein
1Human-Computer Interaction Lab, HCIL, Hornbake Library, University of Maryland, College Park, MD 20742, USA. plaisant@cs.umd.edu
Abstract:
Information Visualization (InfoVis) is now an accepted and growing field but questions remain about the best uses for and the maturity of novel visualizations. Usability studies and controlled experiments are helpful but generalization is difficult. We believe that the systematic development of benchmarks will facilitate the comparison of techniques and help identify their strengths under different conditions. We were involved in the organization and management of three information visualization contests for the 2003, 2004 and 2005 IEEE InfoVis Symposia, which requested teams to report on insights gained while exploring data. We give a summary of the state of the art of evaluation in information visualization, describe the three contests, summarize their results, discuss outcomes and lessons learned, and conjecture the future of visualization contests. All materials produced by the contests are archived in the InfoVis Benchmark Repository.
Related Concept Videos
Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:
Review and Preview
Percentiles are a type of fractile that partition data into...
pV-Diagrams
Interpreting Run Charts
Bar Graph
Self-Evaluation: Self-Enhancement and Self-Verification
