Related Experiment Video
Updated: Jul 17, 2025
06:28
A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
Published on: August 26, 2018
6.0K
Integrated system architecture with mixed-reality user interface for virtual-physical hybrid swarm simulations.
Chuanqi Zheng1, Annalisa Jarecki1, Kiju Lee2,3
1Mechanical Engineering, Texas A&M University, College Station, 77845, TX, USA.
Scientific Reports
|September 7, 2023
Summary
This study presents a hybrid robotic swarm system integrating virtual and physical agents with mixed reality for human interaction. This novel architecture allows users to intuitively manage and control robotic swarms for complex tasks.
Area of Science:
- Robotics
- Human-Computer Interaction
- Swarm Intelligence
Background:
- Traditional robotic systems often lack seamless integration between virtual simulations and physical agents.
- Effective human-swarm interaction is crucial for complex task allocation and real-time monitoring.
- Mixed Reality (MR) offers a promising interface for intuitive control of multi-agent systems.
Purpose of the Study:
- To introduce a novel hybrid robotic swarm system architecture.
- To enable intuitive human-swarm interaction using Mixed Reality (MR) devices.
- To demonstrate the system's capability for task assignment, monitoring, and control.
Main Methods:
- Developed a three-module system: virtual agents, physical agents, and a user interface (UI).
- Integrated modules using Photon Network and Robot Operating System (ROS) bridge for inter-module communication.
- Implemented an MR-based human-swarm interface for user interaction and control.
Main Results:
- Successfully demonstrated system-level integration of virtual and physical robotic agents.
- Validated autonomous task allocation and execution by the hybrid swarm.
- Showcased user capabilities in task creation, swarm monitoring, and direct agent control via MR.
Conclusions:
- The hybrid robotic swarm system effectively integrates virtual and physical agents.
- MR-based interaction provides a powerful and intuitive interface for human-swarm collaboration.
- The system demonstrates potential for advanced applications requiring dynamic task management and real-time control.
Related Concept Videos
01:06Virtual Work for a System of Connected Rigid Bodies
410
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
410
01:30Three-Dimensional Force System:Problem Solving
691
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
691
01:24One-Degree-of-Freedom System
515
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
515
01:30Three-Dimensional Force System
2.1K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.1K
01:22Mechanical Systems
229
Mechanical systems are analogous to to electrical networks where springs and masses play similar roles to inductors and capacitors, respectively. A viscous damper in mechanical systems functions similarly to a resistor in electrical networks, dissipating energy. The forces acting on a mass in such systems include an applied force in the direction of motion, counteracted by forces from the spring, a viscous damper, and the mass's acceleration. This interplay of forces is mathematically...
229