基于相对阶解耦的多智能体系统安全强化学习

黄頔; 张斯伦

doi:10.16383/j.aas.c260090

基于相对阶解耦的多智能体系统安全强化学习

doi: 10.16383/j.aas.c260090 cstr: 32138.14.j.aas.c260090

黄頔^1,,
张斯伦^2,

1.
湖北珞珈实验室武汉 430072 中国
2.
瑞典皇家理工学院数学系斯德哥尔摩 SE 114 28 瑞典

基金项目: 中国航空科学基金(202300010S5001), 国家自然科学基金(61903278)资助

详细信息

作者简介:
黄頔：湖北珞珈实验室副教授. 2017年获得北京大学力学系统与控制专业博士学位. 主要研究方向为航天器智能姿态与轨道控制, 航天器编队控制, 航天器故障诊断及容错控制.本文通信作者. E-mail: dhuang@whu.edu.cn

张斯伦：瑞典皇家理工学院数学系助理教授. 2019年获得瑞典皇家理工学院优化与系统理论专业博士学位. 主要研究方向为非线性控制, 大规模复杂系统, 激励驱动算法和风险规避/安全强化学习. E-mail: silunz@kth.se

计量
- 文章访问数: 8
- HTML全文浏览量: 5
- 被引次数: 0
出版历程
- 收稿日期: 2026-02-03
- 录用日期: 2026-04-12
- 网络出版日期: 2026-09-08

Safe Reinforcement Learning for Multi-Agent Systems Based on Relative-Degree Decoupling

HUANG Di^1
,,
ZHANG Si-Lun^2
,

1.
Hubei Luojia Laboratory, Wuhan 430072, China
2.
Department of Mathematics, KTH Royal Institute of Technology, Stockholm SE 114 28, Sweden

Funds: Supported by the Aeronautical Science Foundation of China (202300010S5001) and National Natural Science Foundation of China (61903278)

More Information

Author Bio:
HUANG Di　Associate professor at the Hubei Luojia Laboratory. He received his Ph.D. degree in mechanical systems and control from Peking University in 2017. His research interests include intelligent attitude and orbit control, spacecraft formation control, and fault diagnosis and fault-tolerant control of spacecraft. Corresponding author of this paper

ZHANG Si-Lun　Assistant professor in the Department of Mathematics, KTH Royal Institute of Technology. He received his Ph.D. degree in optimization and systems theory from KTH Royal Institute of Technology in 2019. His research interests include nonlinear control, large-scale complex systems, incentive-driven algorithms, and risk-averse/safe reinforcement learning

摘要

摘要: 针对存在模型不确定性与外部扰动的多智能体协同控制问题, 提出一种基于模型相对阶解耦的安全强化学习框架. 首先, 利用非线性系统中的相对阶理论, 将高阶状态安全约束映射为输入显式出现的仿射不等式; 在参数凸多面体不确定与有界扰动条件下, 进一步给出由有限个线性不等式交集表征的可认证凸安全动作集, 为在线投影与约束求解提供显式可行域. 其次, 为解决单步屏蔽易产生后继不可行的问题, 设计带终端集的滚动安全滤波器: 在每个时刻维护有限时域备份控制序列, 并通过末端约束与终端控制器保证递归可行与无限时域安全性. 最后, 利用相对阶标准型构建策略分解结构, 以LQR标称控制器提供稳定热启动, 强化学习仅负责对未建模动态进行补偿, 并采用参数共享IPPO学习补偿量. 卫星编队姿态控制仿真结果表明: 在执行器效率不确定与扰动条件下, 所提方法能够将约束违规率维持在近零水平, 同时实现更快的训练收敛与更低的跟踪误差.
- 多智能体系统 /
- 安全强化学习 /
- 相对阶 /
- 控制屏障函数 /
- 安全滤波器
Abstract: To address issues in cooperative multi-agent control subject to model uncertainty and external disturbances, this paper proposes a safe reinforcement learning framework based on model relative-degree decoupling. First, utilizing relative-degree theory in nonlinear systems, high-order state safety constraints are mapped into affine inequalities where the control input appears explicitly. Under conditions of convex-polytope parameter uncertainty and bounded disturbances, a certifiable convex safe action set characterized by the intersection of finite linear inequalities is derived to provide an explicit feasible region for online projection and constraint solving. Second, to overcome the issues of subsequent infeasibility often associated with single-step shielding, a receding-horizon safety filter incorporating a terminal set is designed. By maintaining a finite-horizon backup control sequence at each time step, this filter guarantees recursive feasibility and infinite-horizon safety via terminal constraints and a terminal controller. Finally, a policy decomposition architecture is constructed based on the relative-degree normal form. A linear quadratic regulator (LQR) nominal controller provides a stable warm start, while reinforcement learning compensates for unmodeled dynamics using a parameter-sharing independent proximal policy optimization (IPPO) algorithm. Simulation results on satellite formation attitude control demonstrate that, under actuator efficiency uncertainty and external disturbances, the proposed method maintains a near-zero constraint violation rate while achieving faster training convergence and reduced tracking error.
- multi-agent systems /
- safe reinforcement learning /
- relative degree /
- control barrier functions /
- safety filter

HTML全文

图 1 卫星拓扑图

Fig. 1 Satellite topology diagram

下载: 全尺寸图片幻灯片

图 2 不同方法的训练奖励曲线

Fig. 2 Training reward curves of different methods

下载: 全尺寸图片幻灯片

图 3 不同方法的评估误差曲线

Fig. 3 Evaluation error curves of different methods

下载: 全尺寸图片幻灯片

图 4 不同方法的安全约束违规率对比

Fig. 4 Comparison of safety-constraint violation ratio for different methods

下载: 全尺寸图片幻灯片

图 5 不同方法的最小安全距离对比

Fig. 5 Comparison of minimum safety distance for different methods

下载: 全尺寸图片幻灯片

图 6 不同方法的最大侵入时间对比

Fig. 6 Comparison of maximum intrusion time for different methods

下载: 全尺寸图片幻灯片

表 1 训练超参数设置

Table 1 Training hyperparameter settings

参数	符号	取值
智能体数量	$N$	4
网络结构	–	2层隐藏层(每层256)
激活函数	–	$\tanh$
姿态追踪权重	$w_{{\rm{track}}}$	8.0
角速度惩罚	$w_{{\rm{rate}}}$	0.05
优化器	–	Adam
Actor学习率	–	$3\times 10^{-5}$
Critic学习率	–	$5\times 10^{-4}$
KL早停阈值	–	0.015
预测步长	$H$	6

下载: 导出CSV

参考文献(45)

[1]	L. Huang, B. Li, and L. Zhao, CRESP: Cost-aware recommendation-oriented edge service provision, Tsinghua Sci. Technol., vol. 30, no. 4, pp. 1865–1884, 2025. L. Huang, B. Li, and L. Zhao, CRESP: Cost-aware recommendation-oriented edge service provision, Tsinghua Sci. Technol., vol. 30, no. 4, pp. 1865–1884, 2025.
[2]	F. Fei, S. Li, H. Dai, C. Hu, W. Dou, and Q. Ni, A K-anonymity based schema for location privacy preservation, IEEE Trans. Sustain. Comput., vol. 4, no. 2, pp. 156–167, 2019. F. Fei, S. Li, H. Dai, C. Hu, W. Dou, and Q. Ni, A K-anonymity based schema for location privacy preservation, IEEE Trans. Sustain. Comput., vol. 4, no. 2, pp. 156–167, 2019.
[3]	H. Wan, Y. Wu, Y. Yang, C. Yan, X. Chi, X. Zhang, and S. Shen, Lightweight and privacy-preserving IoT service recommendation based on learning to hash, Tsinghua Sci. Technol., vol. 30, no. 4, pp. 1793–1807, 2025. H. Wan, Y. Wu, Y. Yang, C. Yan, X. Chi, X. Zhang, and S. Shen, Lightweight and privacy-preserving IoT service recommendation based on learning to hash, Tsinghua Sci. Technol., vol. 30, no. 4, pp. 1793–1807, 2025.
[4]	T. Wu, W. Dou, F. Wu, S. Tang, C. Hu, and J. Chen, A deployment optimization scheme over multimedia big data for large-scale media streaming application, ACM Trans. Multimedia Comput. Commun. Appl. (TOMM), vol. 12, no. 5s, p. 73, 2016. T. Wu, W. Dou, F. Wu, S. Tang, C. Hu, and J. Chen, A deployment optimization scheme over multimedia big data for large-scale media streaming application, ACM Trans. Multimedia Comput. Commun. Appl. (TOMM), vol. 12, no. 5s, p. 73, 2016.
[5]	C. Sang and X. Deng, Compatible compositions recommendation for mashup-oriented depopularity Web API, IEEE Trans. Comput. Soc. Syst., vol. 12, no. 5, pp. 1999–2013, 2025. C. Sang and X. Deng, Compatible compositions recommendation for mashup-oriented depopularity Web API, IEEE Trans. Comput. Soc. Syst., vol. 12, no. 5, pp. 1999–2013, 2025.
[6]	L. Qi, R. Wang, C. Hu, S. Li, Q. He, and X. Xu, Time-aware distributed service recommendation with privacy-preservation, Inf. Sci., vol. 480, pp. 354–364, 2019. L. Qi, R. Wang, C. Hu, S. Li, Q. He, and X. Xu, Time-aware distributed service recommendation with privacy-preservation, Inf. Sci., vol. 480, pp. 354–364, 2019.
[7]	M. Tang, F. Xie, S. Lian, J. Mai, and S. Li, Mashup-oriented API recommendation via pre-trained heterogeneous information networks, Inf. Softw. Technol., vol. 169, p. 107428, 2024. M. Tang, F. Xie, S. Lian, J. Mai, and S. Li, Mashup-oriented API recommendation via pre-trained heterogeneous information networks, Inf. Softw. Technol., vol. 169, p. 107428, 2024.
[8]	L. Qi, X. Xu, X. Zhang, W. Dou, C. Hu, Y. Zhou, and J. Yu, Structural balance theory-based E-commerce recommendation over big rating data, IEEE Trans. Big Data, vol. 4, no. 3, pp. 301–312, 2018. L. Qi, X. Xu, X. Zhang, W. Dou, C. Hu, Y. Zhou, and J. Yu, Structural balance theory-based E-commerce recommendation over big rating data, IEEE Trans. Big Data, vol. 4, no. 3, pp. 301–312, 2018.
[9]	R. Xiong, J. Wang, N. Zhang, and Y. Ma, Deep hybrid collaborative filtering for Web service recommendation, Expert Syst. Appl., vol. 110, pp. 191–205, 2018. R. Xiong, J. Wang, N. Zhang, and Y. Ma, Deep hybrid collaborative filtering for Web service recommendation, Expert Syst. Appl., vol. 110, pp. 191–205, 2018.
[10]	Y. Liu, S. Wang, M. S. Khan, and J. He, A novel deep hybrid recommender system based on auto-encoder with neural collaborative filtering, Big Data Min. Anal., vol. 1, no. 3, pp. 211–221, 2018. Y. Liu, S. Wang, M. S. Khan, and J. He, A novel deep hybrid recommender system based on auto-encoder with neural collaborative filtering, Big Data Min. Anal., vol. 1, no. 3, pp. 211–221, 2018.
[11]	B. Cao, X. F. Liu, M. Rahman, B. Li, J. Liu, and M. Tang, Integrated content and network-based service clustering and Web APIs recommendation for mashup development, IEEE Trans. Serv. Comput., vol. 13, no. 1, pp. 99–113, 2020. B. Cao, X. F. Liu, M. Rahman, B. Li, J. Liu, and M. Tang, Integrated content and network-based service clustering and Web APIs recommendation for mashup development, IEEE Trans. Serv. Comput., vol. 13, no. 1, pp. 99–113, 2020.
[12]	G. Kang, Y. Wang, H. Ren, B. Cao, J. Liu, and Y. Wen, KS-GNN: Keyword search via graph neural network for Web API recommendation, IEEE Trans. Netw. Serv. Manag., vol. 21, no. 5, pp. 5464–5474, 2024. G. Kang, Y. Wang, H. Ren, B. Cao, J. Liu, and Y. Wen, KS-GNN: Keyword search via graph neural network for Web API recommendation, IEEE Trans. Netw. Serv. Manag., vol. 21, no. 5, pp. 5464–5474, 2024.
[13]	J. Zhang and Q. Xu, Attention-aware heterogeneous graph neural network, Big Data Min. Anal., vol. 4, no. 4, pp. 233–241, 2021. J. Zhang and Q. Xu, Attention-aware heterogeneous graph neural network, Big Data Min. Anal., vol. 4, no. 4, pp. 233–241, 2021.
[14]	R. Gu, S. Wang, H. Dai, X. Chen, Z. Wang, W. Bao, J. Zheng, Y. Tu, Y. Huang, L. Qi, et al., Fluid-shuttle: Efficient cloud data transmission based on serverless computing compression, IEEE/ACM Trans. Netw., vol. 32, no. 6, pp. 4554–4569, 2024. R. Gu, S. Wang, H. Dai, X. Chen, Z. Wang, W. Bao, J. Zheng, Y. Tu, Y. Huang, L. Qi, et al., Fluid-shuttle: Efficient cloud data transmission based on serverless computing compression, IEEE/ACM Trans. Netw., vol. 32, no. 6, pp. 4554–4569, 2024.
[15]	Z. Liu, Y. Wang, S. Vaidya, F. Ruehle, J. Halverson, M. Soljačić, T. Y. Hou, and M. Tegmark, KAN: Kolmogorov-Arnold networks, arXiv preprint arXiv: 2404.19756, 2024. Z. Liu, Y. Wang, S. Vaidya, F. Ruehle, J. Halverson, M. Soljačić, T. Y. Hou, and M. Tegmark, KAN: Kolmogorov-Arnold networks, arXiv preprint arXiv: 2404.19756, 2024.
[16]	F. Wang, L. Qi, W. Liu, B. Yu, J. Chen, and Y. Xu, Inter- and intra-similarity preserved counterfactual incentive effect estimation for recommendation systems, ACM Trans. Inf. Syst., vol. 43, no. 6, p. 148, 2025. F. Wang, L. Qi, W. Liu, B. Yu, J. Chen, and Y. Xu, Inter- and intra-similarity preserved counterfactual incentive effect estimation for recommendation systems, ACM Trans. Inf. Syst., vol. 43, no. 6, p. 148, 2025.
[17]	K. A. Botangen, J. Yu, Q. Z. Sheng, Y. Han, and S. Yongchareon, Geographic-aware collaborative filtering for web service recommendation, Expert Syst. Appl., vol. 151, p. 113347, 2020. K. A. Botangen, J. Yu, Q. Z. Sheng, Y. Han, and S. Yongchareon, Geographic-aware collaborative filtering for web service recommendation, Expert Syst. Appl., vol. 151, p. 113347, 2020.
[18]	J. Xiang, W. Chen, Y. Wang, B. Liang, Z. Liu, and G. Kang, Interactive web API recommendation for mashup development based on light neural graph collaborative filtering, in Proc. 26^th Int. Conf. Computer Supported Cooperative Work in Design (CSCWD), Rio de Janeiro, Brazil, 2023, pp. 1926−1931. J. Xiang, W. Chen, Y. Wang, B. Liang, Z. Liu, and G. Kang, Interactive web API recommendation for mashup development based on light neural graph collaborative filtering, in Proc. 26^th Int. Conf. Computer Supported Cooperative Work in Design (CSCWD), Rio de Janeiro, Brazil, 2023, pp. 1926−1931.
[19]	Q. Gu, J. Cao, and Y. Liu, CSBR: A compositional semantics-based service bundle recommendation approach for mashup development, IEEE Trans. Serv. Comput., vol. 15, no. 6, pp. 3170–3183, 2022. Q. Gu, J. Cao, and Y. Liu, CSBR: A compositional semantics-based service bundle recommendation approach for mashup development, IEEE Trans. Serv. Comput., vol. 15, no. 6, pp. 3170–3183, 2022.
[20]	X. Xu, Y. Hu, G. Cui, L. Qi, W. Dou, and Z. Cai, CADEC: A combinatorial auction for dynamic distributed DNN inference scheduling in edge-cloud networks, IEEE Trans. Mobile Comput., vol. 24, no. 10, pp. 10024–10041, 2025. X. Xu, Y. Hu, G. Cui, L. Qi, W. Dou, and Z. Cai, CADEC: A combinatorial auction for dynamic distributed DNN inference scheduling in edge-cloud networks, IEEE Trans. Mobile Comput., vol. 24, no. 10, pp. 10024–10041, 2025.
[21]	L. Qi, X. Xu, X. Wu, Q. Ni, Y. Yuan, and X. Zhang, Digital-twin-enabled 6G mobile network video streaming using mobile crowdsourcing, IEEE J. Sel. Areas Commun., vol. 41, no. 10, pp. 3161–3174, 2023. L. Qi, X. Xu, X. Wu, Q. Ni, Y. Yuan, and X. Zhang, Digital-twin-enabled 6G mobile network video streaming using mobile crowdsourcing, IEEE J. Sel. Areas Commun., vol. 41, no. 10, pp. 3161–3174, 2023.
[22]	W. Liang, S. Xie, J. Cai, J. Xu, Y. Hu, Y. Xu, and M. Qiu, Deep neural network security collaborative filtering scheme for service recommendation in intelligent cyber-physical systems, IEEE Internet Things J., vol. 9, no. 22, pp. 22123–22132, 2022. W. Liang, S. Xie, J. Cai, J. Xu, Y. Hu, Y. Xu, and M. Qiu, Deep neural network security collaborative filtering scheme for service recommendation in intelligent cyber-physical systems, IEEE Internet Things J., vol. 9, no. 22, pp. 22123–22132, 2022.
[23]	C. Li, L. Xia, X. Ren, Y. Ye, Y. Xu, and C. Huang, Graph transformer for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 1680−1689. C. Li, L. Xia, X. Ren, Y. Ye, Y. Xu, and C. Huang, Graph transformer for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 1680−1689.
[24]	H. Tang, S. Wu, G. Xu, and Q. Li, Dynamic graph evolution learning for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 1589−1598. H. Tang, S. Wu, G. Xu, and Q. Li, Dynamic graph evolution learning for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 1589−1598.
[25]	Z. Fan, K. Xu, Z. Dong, H. Peng, J. Zhang, and P. S. Yu, Graph collaborative signals denoising and augmentation for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 2037−2041. Z. Fan, K. Xu, Z. Dong, H. Peng, J. Zhang, and P. S. Yu, Graph collaborative signals denoising and augmentation for recommendation, in Proc. 46^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 2037−2041.
[26]	Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and P. S. Yu, A comprehensive survey on graph neural networks, IEEE Trans. Neural Network. Learn. Syst., vol. 32, no. 1, pp. 4–24, 2021. Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and P. S. Yu, A comprehensive survey on graph neural networks, IEEE Trans. Neural Network. Learn. Syst., vol. 32, no. 1, pp. 4–24, 2021.
[27]	Y. Liu, X. Zhou, H. Kou, Y. Zhao, X. Xu, X. Zhang, and L. Qi, Privacy-preserving point-of-interest recommendation based on simplified graph convolutional network for geological traveling, ACM Trans. Intell. Syst. Technol., vol. 15, no. 4, p. 76, 2024. Y. Liu, X. Zhou, H. Kou, Y. Zhao, X. Xu, X. Zhang, and L. Qi, Privacy-preserving point-of-interest recommendation based on simplified graph convolutional network for geological traveling, ACM Trans. Intell. Syst. Technol., vol. 15, no. 4, p. 76, 2024.
[28]	H. Chen, H. Yin, X. Sun, T. Chen, B. Gabrys, and K. Musial, Multi-level graph convolutional networks for cross-platform anchor link prediction, in Proc. 26^th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Virtual Event, 2020, pp. 1503−1511. H. Chen, H. Yin, X. Sun, T. Chen, B. Gabrys, and K. Musial, Multi-level graph convolutional networks for cross-platform anchor link prediction, in Proc. 26^th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Virtual Event, 2020, pp. 1503−1511.
[29]	L. Cai and S. Ji, A multi-scale approach for graph link prediction, in Proc. 34^th AAAI Conf. Artificial Intelligence, New York, USA, 2020, pp. 3308−3315. L. Cai and S. Ji, A multi-scale approach for graph link prediction, in Proc. 34^th AAAI Conf. Artificial Intelligence, New York, USA, 2020, pp. 3308−3315.
[30]	L. Cai, J. Li, J. Wang, and S. Ji, Line graph neural networks for link prediction, IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 9, pp. 5103–5113, 2022. L. Cai, J. Li, J. Wang, and S. Ji, Line graph neural networks for link prediction, IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 9, pp. 5103–5113, 2022.
[31]	L. Gallo, V. Latora, and A. Pulvirenti, MultiplexSAGE: A multiplex embedding algorithm for inter-layer link prediction, IEEE Trans. Neural Network. Learn. Syst., vol. 35, no. 10, pp. 14075–14084, 2024. L. Gallo, V. Latora, and A. Pulvirenti, MultiplexSAGE: A multiplex embedding algorithm for inter-layer link prediction, IEEE Trans. Neural Network. Learn. Syst., vol. 35, no. 10, pp. 14075–14084, 2024.
[32]	Q. Qiu, T. Zhu, H. Gong, L. Chen, and H. Ning, ReLU-KAN: New Kolmogorov-Arnold networks that only need matrix addition, dot multiplication, and ReLU, arXiv preprint arXiv: 2406.02075, 2024. Q. Qiu, T. Zhu, H. Gong, L. Chen, and H. Ning, ReLU-KAN: New Kolmogorov-Arnold networks that only need matrix addition, dot multiplication, and ReLU, arXiv preprint arXiv: 2406.02075, 2024.
[33]	W. Gong, X. Zhang, Y. Chen, Q. He, A. Beheshti, X. Xu, C. Yan, and L. Qi, DAWAR: Diversity-aware web APIs recommendation for mashup creation based on correlation graph, in Proc. 45^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Madrid, Spain, 2022, pp. 395−404. W. Gong, X. Zhang, Y. Chen, Q. He, A. Beheshti, X. Xu, C. Yan, and L. Qi, DAWAR: Diversity-aware web APIs recommendation for mashup creation based on correlation graph, in Proc. 45^th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Madrid, Spain, 2022, pp. 395−404.
[34]	L. Qi, W. Lin, X. Zhang, W. Dou, X. Xu, and J. Chen, A correlation graph based approach for personalized and compatible web APIs recommendation in mobile app development, IEEE Trans. Knowledge Data Eng., vol. 35, no. 6, pp. 5444–5457, 2023. L. Qi, W. Lin, X. Zhang, W. Dou, X. Xu, and J. Chen, A correlation graph based approach for personalized and compatible web APIs recommendation in mobile app development, IEEE Trans. Knowledge Data Eng., vol. 35, no. 6, pp. 5444–5457, 2023.
[35]	H. Kou, J. Xu, and L. Qi, Diversity-driven automated web API recommendation based on implicit requirements, Appl. Soft Comput., vol. 136, p. 110137, 2023. H. Kou, J. Xu, and L. Qi, Diversity-driven automated web API recommendation based on implicit requirements, Appl. Soft Comput., vol. 136, p. 110137, 2023.
[36]	B. Zhang and L. Wang, False negative sample detection for graph contrastive learning, Tsinghua Sci. Technol., vol. 29, no. 2, pp. 529–542, 2024. B. Zhang and L. Wang, False negative sample detection for graph contrastive learning, Tsinghua Sci. Technol., vol. 29, no. 2, pp. 529–542, 2024.
[37]	Y. You, T. Chen, Y. Sui, T. Chen, Z. Wang, and Y. Shen, Graph contrastive learning with augmentations, in Proc. 34^th Int. Conf. Neural Information Processing Systems, Vancouver, BC, Canada, 2020, p. 488. Y. You, T. Chen, Y. Sui, T. Chen, Z. Wang, and Y. Shen, Graph contrastive learning with augmentations, in Proc. 34^th Int. Conf. Neural Information Processing Systems, Vancouver, BC, Canada, 2020, p. 488.
[38]	Y. Wang, L. Yang, W. Gong, M. Khosravi, M. Khan, and W. Rafique, C-DA W AR: Towards diversity-aware web APIs recommendation for mashup creation based on contrastive learning, Tsinghua Sci. Technol., 2025, doi: 10.26599/TST.2025.9010118. Y. Wang, L. Yang, W. Gong, M. Khosravi, M. Khan, and W. Rafique, C-DA W AR: Towards diversity-aware web APIs recommendation for mashup creation based on contrastive learning, Tsinghua Sci. Technol., 2025, doi: 10.26599/TST.2025.9010118.
[39]	Z. Han, T. Zhou, G. Chen, J. Chen, and C. Fu, A robust rating prediction model for recommendation systems based on fake user detection and multi-layer feature fusion, Big Data Min. Anal., vol. 8, no. 2, pp. 292–309, 2025. Z. Han, T. Zhou, G. Chen, J. Chen, and C. Fu, A robust rating prediction model for recommendation systems based on fake user detection and multi-layer feature fusion, Big Data Min. Anal., vol. 8, no. 2, pp. 292–309, 2025.
[40]	S. Wan, S. Pan, J. Yang, and C. Gong, Contrastive and generative graph convolutional networks for graph-based semi-supervised learning, in Proc. 35^th AAAI Conf. Artificial Intelligence, Virtual Event, 2021, pp. 10049−10057. S. Wan, S. Pan, J. Yang, and C. Gong, Contrastive and generative graph convolutional networks for graph-based semi-supervised learning, in Proc. 35^th AAAI Conf. Artificial Intelligence, Virtual Event, 2021, pp. 10049−10057.
[41]	Z. Gong, S. Chen, Q. Dai, Y. Feng, J. Wang, and J. Zhang, SCoAMPS: Semi-supervised graph contrastive learning based on associative memory network and pseudo-label similarity, Big Data Min. Anal., vol. 8, no. 2, pp. 273–291, 2025. Z. Gong, S. Chen, Q. Dai, Y. Feng, J. Wang, and J. Zhang, SCoAMPS: Semi-supervised graph contrastive learning based on associative memory network and pseudo-label similarity, Big Data Min. Anal., vol. 8, no. 2, pp. 273–291, 2025.
[42]	G. Kang, J. Liu, Y. Xiao, B. Cao, Y. Xu, and M. Cao, Neural and attentional factorization machine-based web API recommendation for mashup development, IEEE Trans. Netw. Serv. Manag., vol. 18, no. 4, pp. 4183–4196, 2021. G. Kang, J. Liu, Y. Xiao, B. Cao, Y. Xu, and M. Cao, Neural and attentional factorization machine-based web API recommendation for mashup development, IEEE Trans. Netw. Serv. Manag., vol. 18, no. 4, pp. 4183–4196, 2021.
[43]	L. Qi, Q. He, F. Chen, X. Zhang, W. Dou, and Q. Ni, Data-driven web APIs recommendation for building web applications, IEEE Trans. Big Data, vol. 8, no. 3, pp. 685–698, 2022. L. Qi, Q. He, F. Chen, X. Zhang, W. Dou, and Q. Ni, Data-driven web APIs recommendation for building web applications, IEEE Trans. Big Data, vol. 8, no. 3, pp. 685–698, 2022.
[44]	Z. Ma, S. An, B. Xie, and Z. Lin, Compositional API recommendation for library-oriented code generation, in Proc. 32^nd IEEE/ACM Int. Conf. Program Comprehension (ICPC), Lisbon, Portugal, 2024, pp. 87−98. Z. Ma, S. An, B. Xie, and Z. Lin, Compositional API recommendation for library-oriented code generation, in Proc. 32^nd IEEE/ACM Int. Conf. Program Comprehension (ICPC), Lisbon, Portugal, 2024, pp. 87−98.
[45]	S. Nan, J. Wang, N. Zhang, D. Li, and B. Li, DDASR: Deep diverse API sequence recommendation, ACM Trans. Softw. Eng. Methodol., vol. 34, no. 6, p. 162, 2025. S. Nan, J. Wang, N. Zhang, D. Li, and B. Li, DDASR: Deep diverse API sequence recommendation, ACM Trans. Softw. Eng. Methodol., vol. 34, no. 6, p. 162, 2025.