FlowForge: Guiding the Creation of Multi-Agent Workflows with Design Space Visualization as a Thinking Scaffold

Area of Science:

• Artificial Intelligence
• Human-Computer Interaction

Background:

• Multi-agent workflows decompose complex tasks but designing them is challenging due to vast design spaces.
• Current design methods rely on intuition, leading to inefficiencies and trial-and-error.
• Lack of structured tools hinders optimal multi-agent workflow creation.

Purpose of the Study:

• Introduce FLOWFORGE, an interactive visualization tool for efficient multi-agent workflow design.
• Facilitate structured visual exploration and provide in-situ guidance for workflow creation.
• Address challenges in designing optimal multi-agent workflows.

Main Methods:

• Developed FLOWFORGE, an interactive visualization tool based on formative studies and literature review.
• Organized workflow design into three hierarchical levels: task planning, agent assignment, and agent optimization.
• Integrated context-aware, in-situ suggestions informed by established design patterns.

Main Results:

• FLOWFORGE enables structured visual exploration of the multi-agent workflow design space.
• The tool provides in-situ guidance, enhancing the creation process with practical suggestions.
• User studies demonstrated FLOWFORGE's usability and effectiveness in workflow development.

Conclusions:

• FLOWFORGE effectively facilitates the creation of multi-agent workflows through structured exploration and guidance.
• The tool aids practitioners in navigating complex design spaces and making informed decisions.
• FLOWFORGE offers valuable insights into design space exploration and guidance utilization in workflow development.