A Case Study Using Visualization Interaction Logs and Insight Metrics to Understand How Analysts Arrive at Insights.

Area of Science:

• Human-Computer Interaction
• Information Visualization
• Data Analysis

Background:

• Understanding how users generate insights from visual analytics applications is crucial for improving their design.
• Existing evaluations often focus on insight outcomes rather than the interaction processes leading to them.

Purpose of the Study:

• To investigate the relationship between user interactions and insight generation in a visual analytics application.
• To develop and demonstrate a method for analyzing interaction logs to identify insight-generating patterns.
• To derive design guidelines for enhancing insight generation in visual analytics tools.

Main Methods:

• Conducted an insight-based user study of a visual analytics application.
• Performed quantitative analysis of user insight metrics and interaction logs.
• Utilized qualitative analysis of video recordings to validate quantitative findings.
• Developed an analysis method leveraging interaction log data.

Main Results:

• Identified specific interaction features correlated with insight characteristics.
• Demonstrated an analysis method that links interaction patterns to insight generation.
• Generated design guidelines for visual analytics applications to better support insight discovery.
• Discussed practical considerations and challenges in applying the interaction log analysis method.

Conclusions:

• Interaction log analysis provides a deeper understanding of the insight generation process beyond outcome metrics.
• The proposed method can inform the design of visualization tools to promote more effective analyst behaviors and insights.
• Design guidelines derived from this analysis can enhance user experience and analytical outcomes.