MoGraphGPT:使用模块化LLM和图形控制创建交互场景
IEEE transactions on visualization and computer graphics
|February 24, 2026
概括
本研究介绍了MoGraphGPT,一种使用模块化大型语言模型 (LLM) 的新系统,以简化创建复杂的2D交互场景. 它增强了无编码场景生成的易用性和可控性.
科学领域:
- 计算机图形 计算机图形
- 人与计算机的交互
- 人工智能的人工智能
背景情况:
- 创建交互式2D场景通常需要复杂的编程.
- 现有的大型语言模型 (LLM) 可以生成代码,但往往会产生错误,并且缺乏对多元元素交互的精确图形控制.
研究的目的:
- 开发一个简化创建多个元素的2D交互场景的系统.
- 解决目前基于LLM的代码生成的局限性,特别是易出错和缺乏图形控制.
主要方法:
- 实施了基于上下文的模块化技术,使用单独的LLM模块来实现单个元素和一个中央模块来实现交互.
- 设计了MoGraphGPT,这是一个图形用户界面,集成模块化的LLM与像滑块这样的增强图形控制.
- 使用了自上而下的结构来管理交互,并确保清晰的更新逻辑.
主要成果:
- 与Cursor Composer相比,MoGraphGPT在创建二维交互场景时显著提高了易用性,可控性和性能.
- 一项废除研究证实了模块化技术的有效性.
- 一项开放式的研究证明了该系统的可用性和表现力,用于无编码的场景生成.
结论:
- MoGraphGPT提供了一种有效的解决方案,可以无需编码创建复杂的2D交互场景.
- 模块化的LLM方法与图形控制相结合,增强了用户体验和输出质量.
相关概念视频
Control Systems
1.9K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.9K
Control Systems: Applications
1.3K
Electrical engineering plays a pivotal role in our daily lives, with control systems at the heart of many applications, from home appliances to sophisticated space shuttles. Control systems manage and regulate the behavior of devices and processes, ensuring they function safely, correctly, and efficiently.
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The...
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The...
1.3K
Multi-input and Multi-variable systems
441
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
441
Visual System
2.1K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.1K
Control System Problem
459
In an open-loop system, such as a basic thermostat, the poles of the transfer function influence the system's response but do not determine its stability. However, when feedback is introduced to form a closed-loop system, such as an advanced thermostat that adjusts heating based on room temperature, stability is governed by the new poles of the closed-loop transfer function.
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
459
Open and closed-loop control systems
1.8K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.8K


