Adaptive Safe Control for Bounded Rational Human-Robot Interaction Based on Reinforcement Learning and Reachability...

Safety, as a fundamental requirement in human-robot interaction, imposes high demands on autonomous decision-making. Existing studies often model such interaction as a perfect rational game with full observability, ignoring variation in rationality and perceptual constraints. To address these limitations, this article formulates the safe human-robot interaction as a partially observable system with bounded rationality and adopts the cognitive hierarchy (CH) model to characterize the interaction process. However, partial observability leads to discontinuous evolution of game states, resulting in a nonstandard differential game and causing difficulties for theoretical analysis. Based on hybrid system theory and the CH model, this work establishes a relationship between bounded rationality policies and Nash equilibrium, and provides interpretability for integrating CH with reinforcement learning. To further enhance safety, an adaptive low-conservative backward reachability analysis is introduced. Simulation experiments and evaluations on real-world traffic data validate the effectiveness, safety, efficiency, robustness, and predictive accuracy of our framework, reducing conservatism by more than 70% while causing negligible increases in collision risk and achieving approximately 18% higher prediction accuracy compared to another nonequilibrium game model, the level- $k$ model. Furthermore, compared with multiagent reinforcement learning and inverse reinforcement learning (IRL), our framework achieves a better balance between safety and efficiency.