ReVISit 2: A Full Experiment Life Cycle User Study Framework

Area of Science:

• Computer Science
• Human-Computer Interaction
• Information Visualization

Background:

• Online user studies are crucial for visualization research but designing and conducting them is challenging.
• Existing tools often address only parts of the study lifecycle, hindering reproducibility and advanced designs.

Purpose of the Study:

• To introduce reVISit 2, a comprehensive software framework for designing and conducting browser-based user studies in visualization research.
• To streamline the entire experiment lifecycle, from design to dissemination, and improve study reproducibility.

Main Methods:

• Developed reVISit 2, a software framework supporting all experiment phases: design, debug & pilot, data collection, analysis, and dissemination.
• Integrated technical affordances like interaction replay and sociotechnical aids such as a community support system.
• Demonstrated system utility through publication-quality studies and experimental replications.

Main Results:

• reVISit 2 effectively supports visualization researchers throughout the user study process.
• The framework enhances the ease of conducting studies and improves their reproducibility.
• The system facilitates the creation of advanced interactive studies.

Conclusions:

• reVISit 2 is a valuable tool for visualization researchers, addressing key challenges in conducting online user studies.
• The framework promotes reproducibility and supports the development of sophisticated interactive experiments.
• Future work may involve further community engagement and system enhancements.