Human-robot interaction using retrieval-augmented generation and fine-tuning with transformer neural networks in...

The integration of Artificial Intelligence (AI) in Human-Robot Interaction (HRI) has significantly improved automation in the modern manufacturing environments. This paper proposes a new framework of using Retrieval-Augmented Generation (RAG) together with fine-tuned Transformer Neural Networks to improve robotic decision making and flexibility in group working conditions. Unlike the traditional rigid rule based robotic systems, this approach retrieves and uses domain specific information and responds dynamically in real time, thus increasing the performance of the tasks and the intimacy between people and robots. One of the significant findings of this research is the application of regret-based learning, which helps the robots learn from previous mistakes and reduce regret in order to improve the decisions in the future. A model is developed to represent the interaction between RAG based knowledge acquisition and Transformers for optimization along with regret based learning for predictable improvement. To validate the effectiveness of the proposed system, a numerical case study is carried out to compare the performance with the conventional robotic systems in a production environment. Furthermore, this research offers a clear approach for implementing such a system, which includes the system architecture and parameters for the AI-based human-robot manufacturing systems. This research solves some of the major issues including the problems of scalability, specific fine-tuning, multimodal learning, and the ethical issues in the integration of AI in robotics. The outcomes of the study are important in Industry 5.0, intelligent manufacturing and collaborative robotics, and the advancement of highly autonomous, flexible and intelligent production systems.