Hierarchical-based Prescribed-time Optimal Fault-tolerant Control for Air-ground Cooperative System
-
摘要: 本文研究了发生执行器故障的无人机-无人车异构编队系统的层级预设时间最优编队控制问题. 以保容错性能和收敛速度的优化控制为研究主线, 以层级控制、图博弈理论和预设时间控制为技术基础, 构建了一种预设时间最优容错控制算法. 虚拟层设计了基于一致性跟踪误差和能量消耗的二次型性能指标函数, 借助耦合哈密顿-雅克比-贝尔曼(Hanmilton-Jacobi-Bellman, HJB)方程和强化学习求解近似最优控制策略, 实现多智能体的同步最优控制和交互纳什均衡. 实际控制层基于最优信号并利用滑模控制和自适应技术, 设计了预设时间容错跟踪控制器, 实现对最优编队轨迹的有限时间跟踪. 在保证全局收敛时间完全不依赖于系统的初始状态和控制器参数的同时, 也有效实现对执行器故障参数的逼近. 最后, 通过仿真实验验证了所提控制策略的有效性.Abstract: This article investigates the hierarchical structure-based optimal formation control problem of a heterogeneous formation system of unmanned aerial vehicles and unmanned ground vehicles. This article focuses on the optimization control with fault-tolerant performance and fast convergence speed, and constructs an prescribed-time optimal fault-tolerant control algorithm based on hierarchical control, graphical game theory, and prescribed-time control method. In virtual layer, an quadratic performance index function based on consistency tracking error and energy consumption is designed, and approximate optimal control strategy is obtained by using coupled Hanmilton-Jacobi-Bellman (HJB) equation and reinforcement learning, which achieves synchronous optimal control and interactive Nash equilibrium of multiagent systems. In actual control layer, a prescribed-time fault-tolerant tracking controller is designed based on the optimal signal, sliding-mode and adaptive technologies, which realizes the finite-time tracking of the optimal formation trajectory. The proposed method ensures that the global convergence time is completely independent of the initial states of the system and controller parameters, while also effectively approximating the actuator fault parameters. Finally, the effectiveness of the constructed control strategy is verified through simulation experiment.
-
Key words:
- Air-ground cooperation /
- actuator faults /
- prescribed-time formation /
- graphical game /
- optimal control
-
图 3 虚拟层多智能体X轴一致性跟踪误差
Fig. 3 Consensus tracking errors for agents in X axis of virtual layer
图 5 虚拟层多智能体Z轴一致性跟踪误差
Fig. 5 Consensus tracking errors for agents in Z axis of virtual layer
图 4 虚拟层多智能体Y轴一致性跟踪误差
Fig. 4 Consensus tracking errors for agents in Y axis of virtual layer
图 6 实际层多智能体X轴编队跟踪误差
Fig. 6 Formation tracking errors for agents in X axis of actual layer
图 8 实际层多智能体Z轴编队跟踪误差
Fig. 8 Formation tracking errors for agents in Z axis of actual layer
图 7 实际层多智能体Y轴编队跟踪误差
Fig. 7 Formation tracking errors for agents in Y axis of actual layer
表 1 无人机和无人车的模型参数
Table 1 Model parameters of UAVs and UGVs
序号 参数 数值 1 ${\xi _{xi}},\;{\xi _{yi}},\;{\xi _{zi}}$ $1.2 \times {10^{ - 2}}\ {\rm{N}}\cdot{\rm{s}}/{\rm{rad}}$ 2 $L_i$ $0.5\ {\rm{m}}$ 3 $m_i$ $2\ {\rm{kg}}$ 4 ${\kappa _i}$ $2.98 \times {10^{ - 6}}\ {\rm{N}}\cdot{{\rm{s}}^{\rm{2}}}{\rm{/ra}}{{\rm{d}}^{\rm{2}}}$ 
下载: 导出CSV
-
[1] Yan B, Shi P, Lim C C . Robust Formation Control for Nonlinear Heterogeneous Multiagent Systems Based on Adaptive Event-Triggered Strategy. IEEE Transactions on Automation Science and Engineering,2022 ,19 (4 ):2788 −2800 doi: 10.1109/TASE.2021.3103877[2] Zhang L L, Gao F, Deng F, Xi L L, Chen J . Distributed Estimation of a Layered Architecture for Collaborative Air-Ground Target Geolocation in Outdoor Environments. IEEE Transactions on Industrial Electronics,2023 ,70 (3 ):2822 −2832 doi: 10.1109/TIE.2022.3165245[3] Loria A, Nuno E, Panteley E . Observerless Output-Feedback Consensus-Based Formation Control of Second-Order Nonholonomic Systems. IEEE Transactions on Automatic Control,2022 ,67 (12 ):6934 −6939 doi: 10.1109/TAC.2021.3136140[4] Oh K K, Park M C, Ahn H S . A survey of muitiagent formation control. Automatica,2015 ,53 :424 −440 doi: 10.1016/j.automatica.2014.10.022[5] Hua Y Z, Dong X W, Hu G Q, Li Q D, Ren Z . Distributed Time-Varying Output Formation Tracking for Heterogeneous Linear Multiagent Systems With a Nonautonomous Leader of Unknown Input. IEEE Transactions on Automatic Control,2019 ,64 (10 ):4292 −4299 doi: 10.1109/TAC.2019.2893978[6] Jiang P W, Zhang W, Yan C H, Hu Z . Fully Distributed Event-Triggered Bipartite Output Formation Control for Heterogeneous MASs With Directed Graphs. IEEE Transactions on Circuits and Systems II: Express Briefs,2023 ,70 (6 ):2072 −2076 [7] 周思全, 化永朝, 董希旺, 李清东, 任章 . 面向空地协同作战的无人机无人车异构时变编队跟踪控制. 航空兵器,2019 ,26 (4 ):54 −59 Zhou Si-Quan, Hua Yong-Zhao, Dong Xi-Wang, Li Qing-Dong, Ren Zhang . Air-Ground Time Varying Formation Tracking Control for Heterogeneous UAV-UGV Swarm System. Aero Weaponry,2019 ,26 (4 ):54 −59 [8] Shi J L, Hu B, Chen L, Zhang D X, He D X, Huang J, Guan Z H. Formation Tracking of Heterogeneous UGV-UAV Systems with Switching Directed Topologies. In: Proceedings of the 4th IEEE International Conference on Advanced Robotics and Mechatronics. Osaka, Japen. 2019, 970−975 [9] Vallejo-Alarcon M A, Castro-Linares R, Velasco-Villa M . Unicycle-Type Robot and Quadrotor Leader-Follower Formation Backstepping Control. IFAC - Papers Online,2015 ,48 (19 ):51 −56 doi: 10.1016/j.ifacol.2015.12.009[10] Hua H A, Fang Y C, Zhang X T, Lu B A . A Novel Robust Observer-Based Nonlinear Trajectory Tracking Control Strategy for Quadrotors. IEEE Transactions on Control Systems Technology,2021 ,29 (5 ):1952 −1963 doi: 10.1109/TCST.2020.3024805[11] Fan Q Y, Deng C, Ge X H, Wang C C . Distributed Adaptive Fault-Tolerant Control for Heterogeneous Multiagent Systems With Time-Varying Communication Delays. IEEE Transactions on Systems, Man, and Cybernetics: Systems,2022 ,52 (7 ):4362 −4372 doi: 10.1109/TSMC.2021.3095263[12] Zhang K, Jiang B, Shi P . Adjustable Parameter-Based Distributed Fault Estimation Observer Design for Multiagent Systems With Directed Graphs. IEEE Transactions on Cybernetics,2017 ,47 (2 ):306 −314 [13] Jiang B, Zhang K, Shi P . Integrated Fault Estimation and Accommodation Design for Discrete-Time Takagi-Sugeno Fuzzy Systems With Actuator Faults. IEEE Transactions on Fuzzy Systems,2011 ,19 (2 ):291 −304 doi: 10.1109/TFUZZ.2010.2095861[14] Zhang K, Jiang B, Staroswiecki M . Dynamic Output Feedback-Fault Tolerant Controller Design for Takagi-Sugeno Fuzzy Systems With Actuator Faults. IEEE Transactions on Fuzzy Systems,2010 ,18 (1 ):194 −201 doi: 10.1109/TFUZZ.2009.2036005[15] Wang Y, Qi R, He C. Trajectory and Attitude Cooperative Formation Control for Air-Ground Collaborative Systems under Communication Faults. In: Proceedings of the 6th International Symposium on Autonomous Systems. Nanjing, China. 2023, 1−6 [16] Zhao W, Liu H, Gao Q, Lu J. Robust Optimal Formation Control of Heterogeneous Air-Ground Vehicles Under Communication Faults via Reinforcement Learning. In: Proceedings of the International Conference on Guidance. Harbin, China. 2022, 4145−4155 [17] Zhao W B, Liu H, Valavanis K P, Lewis F L . Fault-Tolerant Formation Control for Heterogeneous Vehicles Via Reinforcement Learning. IEEE Transactions on Aerospace and Electronic Systems,2022 ,58 (4 ):2796 −2806 doi: 10.1109/TAES.2021.3139260[18] Kamel M, Ghamry K, Zhang Y M . Real-Time Fault-Tolerant Cooperative Control of Multiple UAVs-UGVs in the Presence of Actuator Faults. Journal of Intelligent and Robotic Systems,2017 ,88 (2-4 ):469 −480 doi: 10.1007/s10846-016-0463-8[19] Cheng W L, Jiang B, Zhang K, Ding S X . Robust finite-time cooperative formation control of UGV-UAV with model uncertainties and actuator faults. Journal of the Franklin Institute-Engineering and Applied Mathematics,2021 ,358 (17 ):8811 −8837 doi: 10.1016/j.jfranklin.2021.08.038[20] Cheng W L, Jiang B, Zhang K, Ding S X . Fixed-Time Fault-Tolerant Formation Control for Heterogeneous Multi-Agent Systems With Parameter Uncertainties and Disturbances. IEEE Transactions On Circuits and Systems I-regular Papers,2021 ,68 (5 ):2121 −2133 doi: 10.1109/TCSI.2021.3061386[21] Song Y D, Wang Y J, Holloway J, Krstic M A . Time-varying feedback for regulation of normal-form nonlinear systems in prescribed finite time. Automatica,2017 ,83 :243 −251 doi: 10.1016/j.automatica.2017.06.008[22] Wang Z W, Liang B, Sun Y C, Zhang, T . Adaptive Fault-Tolerant Prescribed-Time Control for Teleoperation Systems With Position Error Constraints. IEEE Transactions on Industrial Informatics,2021 ,16 (7 ):4889 −4899 [23] 王龙, 黄锋 . 多智能体博弈、学习与控制. 自动化学报,2023 ,49 (3 ):580 −613 Wang Long, Huang Feng . An Interdisciplinary Survey of Multi-agent Games, Learning, and Control. Acta Automatica Sinica,2023 ,49 (3 ):580 −613 [24] Han X, Zhao X, Sun T, Wu Y, Xu N, Zong G . Event-Triggered Optimal Control for Discrete-Time Switched Nonlinear Systems with Constrained Control Input. IEEE Transactions on Systems, Man, and Cybernetics: Systems,2021 ,51 (12 ):7850 −7859 doi: 10.1109/TSMC.2020.2987136[25] Wang Y, Zhang J, Liu J, Sun J . Optimal Synchronization for Multiagent Systems Under Directed Graphs by Scalable Distributed Event-Triggered Control. IEEE Transactions on Circuits and Systems II: Express Briefs,2023 ,70 (12 ):4539 −4543 [26] Li H, Wu Y, Chen M . Adaptive Fault-Tolerant Tracking Control for Discrete-Time Multiagent Systems via Reinforcement Learning Algorithm. IEEE Transactions on Cybernetics,2021 ,51 (3 ):1163 −1174 doi: 10.1109/TCYB.2020.2982168[27] Li Z, Song Y, Wen G . Reinforcement Learning Based Optimized Sliding-Mode Consensus Control of High-Order Nonlinear Canonical Dynamic Multiagent System. IEEE Systems Journal,2023 ,17 (4 ):6302 −6311 [28] Wang X, Wang G, Li S . Distributed Finite-Time Optimization for Disturbed Second-Order Multiagent Systems. IEEE Transactions on Cybernetics,2021 ,51 (9 ):4634 −4547 doi: 10.1109/TCYB.2020.2988490[29] Cao S, Sun L, Jiang J, Zuo Z . Reinforcement Learning-Based Fixed-Time Trajectory Tracking Control for Uncertain Robotic Manipulators with Input Saturation. IEEE Transactions on Neural Networks and Learning Systems,2023 ,34 (8 ):4584 −4595 doi: 10.1109/TNNLS.2021.3116713[30] Tang Y T, Yi P . Nash Equilibrium Seeking for High-Order Multiagent Systems With Unknown Dynamics. IEEE Transactions on Control of Network Systems,2023 ,10 (1 ):321 −332 doi: 10.1109/TCNS.2022.3203362[31] 于镝 . 基于零和博弈的多智能体网络鲁棒包容控制. 控制与决策,2021 ,36 (8 ):1841 −1848 Yu Di . Robust Containment Control of Multi-Agent Networks Based on Zero-Sum Game. Control and Decision,2021 ,36 (8 ):1841 −1848 [32] Zhao J, Yang C, Wang W D, Xu B, Li Y, Yang L Q, Zhu H, Xiang C L . A Game-Learning-Based Smooth Path Planning Strategy for Intelligent Air-Ground Vehicle Considering Mode Switching. IEEE Transactions on Transportation Electrification,2022 ,8 (3 ):3349 −3366 doi: 10.1109/TTE.2022.3142150[33] Wen G, Li B . Optimized Leader-Follower Consensus Control Using Reinforcement Learning for a Class of Second-Order Nonlinear Multiagent Systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems,2022 ,52 (9 ):5546 −5555 doi: 10.1109/TSMC.2021.3130070[34] Dong H, Zhao X, Yang H . Reinforcement Learning-Based Approximate Optimal Control for Attitude Reorientation Under State Constraints. IEEE Transactions on Control Systems Technology,2021 ,29 (4 ):1664 −1673 doi: 10.1109/TCST.2020.3007401[35] Cao Z, Guo G . Fixed-time sliding mode formation control of AUVs based on a disturbance observer. IEEE/CAA Journal of Automatica Sinica,2020 ,7 (2 ):539 −545 doi: 10.1109/JAS.2020.1003057[36] Chen F Y, Jiang R, Zhang K, Jiang B, Tao G . Robust backstepping sliding-mode control and observer-based fault estimation for a quadrotor UAV. IEEE Transactions on Industrial Electronics,2016 ,63 (8 ):5044 −5056 -
点击查看大图
计量
- 文章访问数: 42
- HTML全文浏览量: 19
- 被引次数: 0
