从基础智能到通用智能: 基于大模型的GenAI和AGI之现状与展望

缪青海; 王兴霞; 杨静; 赵勇; 王雨桐; 陈圆圆; 田永林; 俞怡; 林懿伦; 鄢然; 马嘉琪; 那晓翔; 王飞跃

doi:10.16383/j.aas.c240156

从基础智能到通用智能: 基于大模型的GenAI和AGI之现状与展望

doi: 10.16383/j.aas.c240156

缪青海^1,,
王兴霞^{1, 2,},
杨静^{1, 2,},
赵勇^3,,
王雨桐^2,,
陈圆圆^2,,
田永林^2,,
俞怡^4,,
林懿伦^4,,
鄢然^5,,
马嘉琪^6,,
那晓翔^7,,
王飞跃^{1, 2,}

1.
中国科学院大学人工智能学院北京 100049 中国
2.
中国科学院自动化研究所复杂系统管理与控制国家重点实验室北京 100190 中国
3.
国防科技大学系统工程学院长沙 410000 中国
4.
上海人工智能实验室上海 200232 中国
5.
南洋理工大学土木与环境工程学院新加坡 639798 新加坡
6.
加州大学洛杉矶分校萨穆埃利工程学院洛杉矶 90095 美国
7.
剑桥大学工程系剑桥 CB2 1TN 英国

基金项目: 国家自然科学基金(62271485, 61903363, U1811463)资助

详细信息

作者简介:
缪青海：中国科学院大学人工智能学院副教授. 主要研究方向为智能系统, 智能交通, 平行智能. E-mail: miaoqh@ucas.ac.cn

王兴霞：中国科学院自动化研究所复制系统管理与控制国家重点实验室博士研究生. 2021年获得南开大学工学硕士学位. 主要研究方向为平行智能, 平行油田, 多智能体系统. E-mail: wangxingxia2022@ia.ac.cn

杨静：中国科学院自动化研究所复杂系统管理与控制国家重点实验室博士研究生. 2020年获得北京化工大学自动化专业学士学位. 主要研究方向为平行制造, 社会制造, 人工智能和社会物理信息系统. E-mail: yangjing2020@ia.ac.cn

赵勇：国防科技大学系统工程学院博士研究生. 2021年获国防科技大学控制科学与工程专业硕士学位. 主要研究方向为移动群智感知, 空间众包, 人机交互. E-mail: zhaoyong15@nudt.edu.cn

王雨桐：中国科学院自动化研究所助理研究员. 2021年获得中国科学院大学控制理论与控制工程专业博士学位. 主要研究方向为计算机视觉. E-mail: yutong.wang@ia.ac.cn

陈圆圆：中国科学院自动化研究所副研究员. 2018年获得中国科学院大学控制理论与控制工程专业博士学位. 主要研究方向为交通数据分析, 社会交通, 平行交通管理与控制系统. E-mail: yuanyuan.chen@ia.ac.cn

田永林：中国科学院自动化研究所博士后. 2022年获得中国科学技术大学控制理论与控制工程专业博士学位. 主要研究方向为平行智能, 自动驾驶, 智能交通. E-mail: yonglin.tian@ia.ac.cn

俞怡：上海人工智能实验室助理研究员. 主要研究方向为智能交通系统, 数据要素化, 城市计算. E-mail: yuyi@pjlab.org.cn

林懿伦：上海人工智能实验室副研究员. 2019年获得中国科学院大学控制理论与控制工程专业博士学位. 主要研究方向为社会计算, 平行智能, 深度学习, 智能交通系统与人工智能安全. E-mail: linyilun@pjlab.org.cn

鄢然：新加坡南洋理工大学土木与环境工程学院助理教授. 主要研究方向为海事研究中的数据分析, 海运大数据, 绿色航运管理, 海事风险管理以及港口和航运优化. E-mail: ran.yan@ntu.edu.sg

马嘉琪：加州大学洛杉矶分校萨穆埃利工程学院副教授, 加州大学洛杉矶分校交通研究所副所长. 2014年获得弗吉尼亚大学交通运输工程博士学位. 主要研究方向为联网和自动化车辆, 网络物理运输系统, 运输系统的弹性, 分布式多智能体系统的协同控制, 智能交通系统, 动态运输系统建模和控制, 网络优化, 出行行为建模和需求预测, 人工智能和先进计算在交通领域的应用. E-mail: jiaqima@ucla.edu

那晓翔：英国剑桥大学工程系长聘助理教授. 2014年获英国剑桥大学机械工程博士学位. 主要研究方向为重型商用车智能车载信息系统开发与车辆能耗特性评价. E-mail: xnhn2@cam.ac.uk

王飞跃：中国科学院自动化研究所复杂系统管理与控制国家重点实验室研究员. 主要研究方向为智能系统和复杂系统的建模、分析与控制. 本文通信作者. E-mail: feiyue.wang@ia.ac.cn

计量
- 文章访问数: 2701
- HTML全文浏览量: 562
- PDF下载量: 1215
- 被引次数: 0
出版历程
- 收稿日期: 2024-03-29
- 录用日期: 2024-04-07
- 网络出版日期: 2024-04-15
- 刊出日期: 2024-04-26

From Foundation Intelligence to General Intelligence: The State-of-Art and Perspectives of GenAI and AGI Based on Foundation Models

MIAO Qing-Hai^1
,,
WANG Xing-Xia^{1, 2
,},
YANG Jing^{1, 2
,},
ZHAO Yong^3
,,
WANG Yu-Tong^2
,,
CHEN Yuan-Yuan^2
,,
TIAN Yong-Lin^2
,,
YU Yi^4
,,
LIN Yi-Lun^4
,,
YAN Ran^5
,,
MA Jia-Qi^6
,,
NA Xiao-Xiang^7
,,
WANG Fei-Yue^{1, 2
,}

1.
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
2.
The State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
3.
College of Systems Engineering, National University of Defense Technology, Changsha 410000, China
4.
Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China
5.
School of Civil and Environmental Engineering, Nanyang Technological University, Singapore 639798, Singapore
6.
UCLA Samueli School of Engineering, Los Angeles 90095, U.S.
7.
Department of Engineering, University of Cambridge, Cambridge CB2 1TN, U.K.

Funds: Supported by National Natural Science Foundation of China (62271485, 61903363, U1811463)

More Information

Author Bio:
MIAO Qing-Hai　Associate professor at School of Artificial Intelligence, University of Chinese Academy of Sciences. His research interest covers intelligent systems, intelligent transportation systems, parallel intelligence

WANG Xing-Xia　Ph.D. candidate at the State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences. She received her master degree in engineering from Nankai University in 2021. Her research interest covers parallel intelligence, parallel oilfields, and multi-agent systems

YANG Jing　Ph.D. candidate at the State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences. She received her bachelor degree in automation from Beijing University of Chemical Technology in 2020. Her research interest covers parallel manufacturing, social manufacturing, artificial intelligence, and cyber-physical-social systems

ZHAO Yong　Ph.D. candidate at the College of Systems Engineering, National University of Defense Technology. He received his master degree in control science and engineering from National University of Defense Technology in 2021. His research interest covers mobile crowdsensing, spatial crowdsourcing, and human computer interaction

WANG Yu-Tong　Assistant professor at the Institute of Automation, Chinese Academy of Sciences. She received her Ph.D. degree in control theory and control engineering from the University of Chinese Academy of Sciences in 2021. Her main research interest is computer vision

CHEN Yuan-Yuan　Associate professor at the Institute of Automation, Chinese Academy of Sciences. He received his Ph.D. degree in control theory and control engineering from University of Chinese Academy of Sciences in 2018. His research interest covers traffic data analytics, social transportation, and parallel traffic management and control systems

TIAN Yong-Lin　Postdoctor at the Institute of Automation, Chinese Academy of Sciences. He received his Ph.D. degree in control theory and control engineering from the University of Science and Technology of China, in 2022. His research interest covers parallel intelligence, autonomous driving, and intelligent transportation systems

YU Yi　Assistant professor at Shanghai Artificial Intelligence Laboratory. Her research interest covers intelligent transportation systems, data trading, and urban computing

LIN Yi-Lun　Associate professor at Shanghai Artificial Intelligence Laboratory. He received his Ph.D. degree in control theory and control engineering from the University of Chinese Academy of Sciences, in 2019. His research interest covers social computing, parallel intelligence, deep learning, intelligent transportation systems and AI safety

YAN Ran　Assistant professor at the School of Civil and Environmental Engineering, Nanyang Technological University, Singapore. Her research interest covers data analytics in maritime studies, big data in maritime transport, green-shipping management, maritime risk management, and port and shipping optimization

MA Jia-Qi　Associate professor at the UCLA Samueli School of Engineering and associate director of UCLA Institute of Transportation Studies. He received his Ph.D. degree of transportation engineering from University of Virginia, 2014. His research interest covers connected and automated vehicles; cyber-physical transportation systems; transportation systems resilience; cooperative control of distributed multi-agent systems; intelligent transportation systems; dynamic transportation systems modeling and control; network optimization; travel behavior modeling and demand forecasting; artificial intelligence and advanced computing applications in transportation

NA Xiao-Xiang　University assistant professor in the Department of Engineering, University of Cambridge, U.K.. He received his Ph.D. degree in mechanical engineering from University of Cambridge, U.K.. His research interest covers development of intelligent telematics systems for heavy goods vehicles and assessment of vehicle energy performance

WANG Fei-Yue　Professor at the State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences. His research interest covers modeling, analysis, and control of intelligent systems and complex systems. Corresponding author of this paper

摘要

摘要: 本文对生成式AI (Generative artificial intelligence, GenAI)的国内外发展现状进行了概述, 重点分析了中美之间在算力、数据、算法、生态等方面存在的差距. 为改变我国在生成式AI领域的落后现状, 提出高能效算力建设、联邦数据、专业领域模型、基于TAO的联邦生态等应对策略, 对大模型时代AI安全治理进行了论述, 对通用人工智能(Artificial general intelligence, AGI)的未来发展进行了展望.
- 生成式人工智能 /
- 大语言模型 /
- 基础模型 /
- 通用人工智能 /
- 基础智能 /
- 平行智能 /
- Sora
Abstract: This article provides an overview of the current development status of generative artificial intelligence (GenAI) both in China and abroad, focusing on the analysis of the gap between China and the United States in terms of computing power, data, algorithms, and ecosystems. To change the backward situation of China in the field of generative AI, perspectives such as constructing high-energy-efficient computing, federated data, specialized domain models, and a federated ecosystem based on TAO are proposed. It also discusses AI security governance in the era of foundation intelligence and prospects for the future development of artificial general intelligence (AGI).
- Generative artificial intelligence (GenAI) /
- large language model /
- foundation model /
- artificial general intelligence (AGI) /
- foundation intelligence /
- parallel intelligence /
- Sora
注释:

1) 1¹ https://hunyuan.tencent.com/² https://xinghuo.xfyun.cn/³ https://kimi.moonshot.cn/⁴ https://taichu-web.ia.ac.cn/⁵ https://www.baai.ac.cn/⁶ https://www.lingyiwanwu.com/⁷ https://zhipuai.cn/⁸ https://www.ecnu.edu.cn/info/1426/65145.htm

2) 2⁹ https://www.seiee.sjtu.edu.cn/index_news/8667.html¹⁰ https://github.com/blcuicall/taoli¹¹ https://www.mathgpt.com/¹² https://ziyue.youdao.com//home¹³ http://dicp.cas.cn/xwdt/kyjz/202403/t20240324_7050498.html¹⁴ http://www.ciictec.com/ciigpt¹⁵ http://www.cctegxian.com/html/news/2023-12-18/4185.html¹⁶ https://github.com/CMKRG/QiZhenGPT¹⁷ http://web-qa.medlinker.com/pc/product/medgpt¹⁸ http://www.dajingtcm.com/node/21¹⁹ https://github.com/ywjawmw/TCMEB²⁰ https://github.com/SupritYoung/Zhongjing²¹ https://github.com/jerry1993-tech/Cornucopia-LLaMA-Fin-Chinese.git

3) 3²² https://www.hundsun.com/lightgpt²³ https://www.langboat.com/portal/mengzi-gpt²⁴ https://github.com/AbaciNLP/InvestLM

4) 4²⁵ https://resources.nvidia.com/en-us-tensor-core/nvidia-tensorcore-gpu-datasheet²⁶ https://e.huawei.com/cn/products/computing/ascend²⁷ https://www.nvidia.com/en-us/data-center/h200/²⁸ https://www.nvidia.com/en-us/data-center/gb200-nvl72/²⁹ 阿里研究院《中美大模型的竞争之路: 从训练数据讲起》报告.³⁰ https://pubmed.ncbi.nlm.nih.gov/³¹ https://pile.eleuther.ai/

5) 5³² https://www.stateof.ai/³³ https://www.aminer.org/

HTML全文

图 1 国产大模型发展全景

Fig. 1 Panorama of the development of domestic large models

下载: 全尺寸图片幻灯片

图 2 人工智能全生命周期四阶段主要风险, 风险影响范围随技术发展逐渐增大

Fig. 2 The main risks of the four stages in the artificial intelligence lifecycle, and the risk impact gradually increases with technological development

下载: 全尺寸图片幻灯片

图 3 国内人工智能安全评估体系

Fig. 3 Artificial intelligence safety evaluation system in China

下载: 全尺寸图片幻灯片

表 1 国外主要GenAI模型

Table 1 Typical foreign GenAI models

模型	发布时间	开发者	输入模态				输出模态
模型	发布时间	开发者	文本	语音	图像	视频	文本	语音	图像	视频
GPT-1	2018年6月	OpenAI	√				√
BERT	2018年10月	Google	√				√
GPT-2	2019年2月	OpenAI	√				√
RoBERTa	2019年7月	Meta	√				√
T5	2019年10月	Google	√				√
GPT-3	2020年5月	OpenAI	√				√
GPT-3.5	2022年3月	OpenAI	√				√
GPT-4	2023年3月	OpenAI	√	√	√		√	√	√
PaLM 2	2023年5月	Google	√				√
Llama 2	2023年6月	Meta	√				√
Claude 3	2024年3月	Anthropic	√				√
MusicLM	2023年5月	Google	√					√
MusicGen	2023年6月	Meta	√					√
Voicebox	2023年6月	Meta	√	√				√
DALL·E	2021年1月	OpenAI	√						√
DALL·E 2	2022年4月	OpenAI	√						√
Stable Diffusion	2022年8月	Stability AI	√		√				√
Midjourney	2022年7月	Midjourney	√						√
Firefly	2023年3月	Adobe	√						√
DALL·E 3	2023年9月	OpenAI	√						√
Imagen 2	2023年12月	Google	√						√
Make-A-Video	2022年9月	Meta	√	√		√				√
Gen-2	2023年2月	Runway	√	√		√				√
Lumiere	2024年1月	Google	√	√						√
Sora	2024年2月	OpenAI	√							√

下载: 导出CSV

表 2 中美生成式AI领域现状

Table 2 Current status of generative AI fields in China and the United States

对比条目		国内	国外
算力	处理器	昇腾910	H100 SXM
	速度 (FP16)	280 TFLOPS	1979 TFLOPS
	显存	16 G	80 G
	互联带宽	—	900 GB/s
	并行平台API	CANN	CUDA
数据	政府部门	有限开放	能开尽开
	社会力量	碎片、孤立	联合、开源
	数据生态	尚未形成	趋于完善
算法	基本算法	—	Transformer
	语言模型	文心一言等	GPT/Llama
	文生图	秒画等	DALL·E/Imagen
	文本生成视频	—	Sora
	多模态	悟道等	GPT-4等
生态	独角兽量/值^#	70/1.3T	315/5.9T
	高引论文^#	60+	220+
	机构/人才占比^*	14%/13.85%	55%/56.55%
	创新城市数量^*	19	33
注: ^# State of AI Report 2023, ^*Aminer

下载: 导出CSV

参考文献(106)

[1]	Wang F Y, Miao Q H, Li X, Wang X X, Lin Y L. What does ChatGPT say: The DAO from algorithmic intelligence to linguistic intelligence. IEEE/CAA Journal of Automatica Sinica, 2023, 10(3): 575−579 doi: 10.1109/JAS.2023.123486
[2]	Wang F Y, Miao Q H, Li L X, Ni Q H, Li X, Li J J, et al. When does sora show: The beginning of TAO to imaginative intelligence and scenarios engineering. IEEE/CAA Journal of Automatica Sinica, 2024, 11(4): 809−815 doi: 10.1109/JAS.2024.124383
[3]	Yu H K, Liu X Y, Tian Y L, Wang Y T, Gou C, Wang F Y. Sora-based parallel vision for smart sensing of intelligent vehicles: From foundation models to foundation intelligence. IEEE Transactions on Intelligent Vehicles, DOI: 10.1109/TIV.2024.3376575
[4]	LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015, 521(7553): 436−444 doi: 10.1038/nature14539
[5]	LeCun Y, Boser B, Denker J S, Henderson D, Howard R E, Hubbard W, et al. Backpropagation applied to handwritten zip code recognition. Neural Computation, 1989, 1(4): 541−551 doi: 10.1162/neco.1989.1.4.541
[6]	Graves A, Schmidhuber J. Supervised sequence labelling with recurrent neural networks. In: Proceedings of the Conference and Workshop on Neural Information Processing Systems. 2009.
[7]	Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets. Neural Computation, 2006, 18(7): 1527−1554 doi: 10.1162/neco.2006.18.7.1527
[8]	Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, USA: Curran Associates Inc., 2012.
[9]	Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, et al. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, USA: Curran Associates Inc., 2017. 5998−6008
[10]	Devlin J, Chang M W, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Minneapolis, USA: ACL, 2019. 4171−4186
[11]	Radford A, Narasimhan K, Salimans T, Sutskever I. Improving Language Understanding by Generative Pre-Training, OpenAI Technical Report, 2018.
[12]	Dai Z H, Yang Z L, Yang Y M, Carbonell J, Le Q, Salakhutdinov R. Transformer-XL: Attentive language models beyond a fixed-length context. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Florence, Italy: ACL, 2019. 2978−2988
[13]	Du H P, Teng S Y, Chen H, Ma J Q, Wang X, Gou C, et al. Chat with ChatGPT on intelligent vehicles: An IEEE TIV perspective. IEEE Transactions on Intelligent Vehicles, 2023, 8(3): 2020−2026 doi: 10.1109/TIV.2023.3253281
[14]	Gao Y B, Tong W, Wu E Q, Chen W, Zhu G Y, Wang F Y. Chat with ChatGPT on interactive engines for intelligent driving. IEEE Transactions on Intelligent Vehicles, 2023, 8(3): 2034−2036 doi: 10.1109/TIV.2023.3252571
[15]	Guo C, Lu Y, Dou Y, Wang F Y. Can ChatGPT boost artistic creation: The need of imaginative intelligence for parallel art. IEEE/CAA Journal of Automatica Sinica, 2023, 10(4): 835−838 doi: 10.1109/JAS.2023.123555
[16]	Wang S Y, Zhu Y X, Li Z H, Wang Y T, Li L, He Z B. ChatGPT as your vehicle co-pilot: An initial attempt. IEEE Transactions on Intelligent Vehicles, 2023, 8(12): 4706−4721 doi: 10.1109/TIV.2023.3325300
[17]	Wang F Y. Linguistic intelligence for intelligent vehicles: ChatGPT and future logistics and mobility. IEEE Transactions on Intelligent Vehicles, 2023, 8(3): 2011−2019 doi: 10.1109/TIV.2023.3256799
[18]	Tian Y L, Li X, Zhang H, Zhao C, Li B, Wang X, et al. VistaGPT: Generative parallel transformers for vehicles with intelligent systems for transport automation. IEEE Transactions on Intelligent Vehicles, 2023, 8(9): 4198−4207 doi: 10.1109/TIV.2023.3307012
[19]	Yu H, Wang Y T, Tian Y L, Zhang H, Zheng W B, Wang F Y. Social vision for intelligent vehicles: From computer vision to foundation vision. IEEE Transactions on Intelligent Vehicles, 2023, 8(11): 4474−4476 doi: 10.1109/TIV.2023.3330870
[20]	Xue X, Yu X N, Wang F Y. ChatGPT chats on computational experiments: From interactive intelligence to imaginative intelligence for design of artificial societies and optimization of foundational models. IEEE/CAA Journal of Automatica Sinica, 2023, 10(6): 1357−1360 doi: 10.1109/JAS.2023.123585
[21]	Wang F Y, Li J J, Qin R, Zhu J, Mo H, Hu B. ChatGPT for computational social systems: From conversational applications to human-oriented operating systems. IEEE Transactions on Computational Social Systems, 2023, 10(2): 414−425 doi: 10.1109/TCSS.2023.3252679
[22]	卢经纬, 郭超, 戴星原, 缪青海, 王兴霞, 杨静, 等. 问答ChatGPT之后: 超大预训练模型的机遇和挑战. 自动化学报, 2023, 49(4): 705−717 Lu Jing-Wei, Guo Chao, Dai Xing-Yuan, Miao Qing-Hai, Wang Xing-Xia, Yang Jing, et al. The ChatGPT after: Opportunities and challenges of very large scale pre-trained models. Acta Automatica Sinica, 2023, 49(4): 705−717
[23]	田永林, 王雨桐, 王建功, 王晓, 王飞跃. 视觉Transformer研究的关键问题: 现状及展望. 自动化学报, 2022, 48(4): 957−979 Tian Yong-Lin, Wang Yu-Tong, Wang Jian-Gong, Wang Xiao, Wang Fei-Yue. Key problems and progress of vision transformers: The state of the art and prospects. Acta Automatica Sinica, 2022, 48(4): 957−979
[24]	Yang Z L, Dai Z H, Yang Y M, Carbonell J, Salakhutdinov Le Q V. XLNet: Generalized autoregressive pretraining for language understanding. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2019. Article No. 517
[25]	Ho J, Jain A, Abbeel P. Denoising diffusion probabilistic models. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. Article No. 574
[26]	Liu Y H, Ott M, Goyal N, Du J F, Joshi M, Chen D Q, et al. RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv: 1907.11692, 2019.
[27]	Lewis M, Liu Y H, Goyal N, Ghazvininejad M, Mohamed A, Levy O, et al. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACL, 2020. 7871−7880
[28]	Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, et al. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research, 2020, 21(1): Article No. 140
[29]	Radford A, Narasimhan K, Salimans T, Sutskever I. Improving language understanding by generative pre-training. Open AI, 2018, 8(9−10): 1−9
[30]	Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Florencia B, et al. GPT-4 technical report. arXiv preprint arXiv: 2303.08774, 2023.
[31]	Anil R, Dai A M, Firat O, Johnson M, Lepikhin D, Passos A, et al. PaLM 2 technical report. arXiv preprint arXiv: 2305.10403, 2023.
[32]	Touvron H, Lavril T, Izacard G, Martinet X, Lachaux M A, Lacroix T, et al. LLaMA: Open and efficient foundation language models. arXiv preprint arXiv: 2302.13971, 2023.
[33]	Touvron H, Martin L, Stone K, Albert P, Almahairi A, Babaei Y, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv: 2307.09288, 2023.
[34]	Anthropic. Introducing the next generation of Claude [Online], available: https://www.anthropic.com/news/claude-3-family, March 28, 2024
[35]	Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X H, Unterthiner T, et al. An image is worth 16×16 words: Transformers for image recognition at scale. In: Proceedings of the International Conference on Learning Representations. 2021.
[36]	Ramesh A, Dhariwal P, Nichol A, Chu C, Chen M. Hierarchical text-conditional image generation with CLIP latents. arXiv preprint arXiv: 2204.06125, 2022.
[37]	Betker J, Goh G. Improving image generation with better captions. Computer Science, 2023, 2(3): 8
[38]	Rombach R, Blattmann A, Lorenz D, Esser P, Ommer B. High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 10674−10685
[39]	Singer U, Polyak A, Hayes T, Yin X, An J, Zhang S Y, et al. Make-A-Video: Text-to-video generation without text-video data. arXiv preprint arXiv: 2209.14792, 2022.
[40]	Bar-Tal O, Chefer H, Tov O, Herrmann C, Paiss R, Zada S, et al. Lumiere: A space-time diffusion model for video generation. arXiv preprint arXiv: 2401.12945, 2024.
[41]	Brooks T, Peebles B, Holmes C, DePue W, Guo Y F, Jing L, et al. Video generation models as world simulators [Online], available: https://openai.com/research/video-generation-models-as-world-simulators, March 28, 2024
[42]	Sun Y, Wang S H, Feng S K, Ding S Y, Pang C, Shang J Y, et al. ERNIE 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation. arXiv preprint arXiv: 2107.02137, 2021.
[43]	Bai J Z, Bai S, Chu Y F, Cui Z Y, Dang K, Deng X D, et al. Qwen technical report. arXiv preprint arXiv: 2309.16609, 2023.
[44]	Zeng W, Ren X Z, Su T, Wang H, Liao Y, Wang Z W, et al. PanGu-α: Large-scale autoregressive pretrained Chinese language models with auto-parallel computation. arXiv preprint arXiv: 2104.12369, 2021.
[45]	Team I L M. InternLM: A multilingual language model with progressively enhanced capabilities [Online], available: https://github.com/InternLM/InternLM, March 28, 2024
[46]	Yang A Y, Xiao B, Wang B N, Zhang B R, Bian C, Yin C, et al. Baichuan 2: Open large-scale language models. arXiv preprint arXiv: 2309.10305, 2023.
[47]	王飞跃. 数字教师与平行教育: 关于ChatGPT之后教学变革的探讨. 智能科学与技术学报, 2023, 5(4): 454−463 Wang Fei-Yue. Digital teachers and parallel education: A paradigm shift in teaching and learning after ChatGPT. Chinese Journal of Intelligent Science and Technology, 2023, 5(4): 454−463
[48]	王飞跃. 平行医生与平行医院: ChatGPT与通用人工智能技术对未来医疗的冲击与展望. 协和医学杂志, 2023, 14(4): 673−679 Wang Fei-Yue. Parallel doctors and parallel hospitals: Impact and perspective of ChatGPT-like AIGC and AGI on medicine and medicare. Medical Journal of Peking Union Medical College Hospital, 2023, 14(4): 673−679
[49]	Lu J W, Wang X X, Cheng X, Yang J, Kwan O, Wang X. Parallel factories for smart industrial operations: From big AI models to field foundational models and scenarios engineering. IEEE/CAA Journal of Automatica Sinica, 2022, 9(12): 2079−2086 doi: 10.1109/JAS.2022.106094
[50]	Yang J, Li S M, Wang X X, Lu J W, Wu H Y, Wang X. DeFACT in ManuVerse for parallel manufacturing: Foundation models and parallel workers in smart factories. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2188−2199 doi: 10.1109/TSMC.2022.3228817
[51]	Yang J, Wang Y T, Wang X X, Wang X X, Wang X, Wang F Y. Generative AI empowering parallel manufacturing: Building a “6S” collaborative production ecology for manufacturing 5.0. IEEE Transactions on Systems, Man, and Cybernetics: Systems, DOI: 10.1109/TSMC.2024.3349555
[52]	Zhao C, Wang X, Lv Y S, Tian Y L, Lin Y L, Wang F Y. Parallel transportation in transverse: From foundation models to DeCAST. IEEE Transactions on Intelligent Transportation Systems, 2023, 24(12): 15310−15327 doi: 10.1109/TITS.2023.3311585
[53]	Zhao C, Dai X Y, Lv Y S, Tian Y L, Ren Y H, Wang F Y. Foundation models for transportation intelligence: ITS convergence in TransVerse. IEEE Intelligent Systems, 2022, 37(6): 77−82 doi: 10.1109/MIS.2022.3221342
[54]	Wang X, Wang Y T, Yang J, Jia X F, Li L J, Ding W P, et al. The survey on multi-source data fusion in cyber-physical-social systems: Foundational infrastructure for industrial metaverses and industries 5.0. Information Fusion, 2024, 107: Article No. 102321 doi: 10.1016/j.inffus.2024.102321
[55]	Wang X X, Cheng X, Lu J W, Kwan O, Li S X, Ping Z X. Metaverses-based parallel oil fields in CPSS: A framework and methodology. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2138−2147 doi: 10.1109/TSMC.2022.3228934
[56]	Wang Y T, Wang J G, Cao Y S, Li S X, Kwan O. Integrated inspection on PCB manufacturing in cyber-physical-social systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2098−2106 doi: 10.1109/TSMC.2022.3229096
[57]	Wang Y T, Tian Y L, Wang J G, Cao Y S, Li S X, Tian B. Integrated inspection of QoM, QoP, and QoS for AOI industries in metaverses. IEEE/CAA Journal of Automatica Sinica, 2022, 9(12): 2071−2078 doi: 10.1109/JAS.2022.106091
[58]	Kang M Z, Wang X J, Wang H Y, Hua J, Reffye P D, Wang F Y. The development of AgriVerse: Past, present, and future. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(6): 3718−3727 doi: 10.1109/TSMC.2022.3230830
[59]	Han X, Meng Z L, Xia X, Liao X S, He B Y, Zheng Z L, et al. Foundation intelligence for smart infrastructure services in transportation 5.0. IEEE Transactions on Intelligent Vehicles, 2024, 9(1): 39−47 doi: 10.1109/TIV.2023.3349324
[60]	Wang F Y, Lv C. Foundation vehicles: From foundation intelligence to foundation transportation for future mobility. IEEE Transactions on Intelligent Vehicles, 2023, 8(10): 4287−4291 doi: 10.1109/TIV.2023.3326636
[61]	Liu Y H, Shen Y, Tian Y L, Ai Y F, Tian B, Wu E, et al. Radarverses in metaverses: A CPSI-based architecture for 6S radar systems in CPSS. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2128−2137 doi: 10.1109/TSMC.2022.3228590
[62]	Chen Y Y, Lv Y S, Wang F Y. The DAO to social transportation: Towards smart mobility in cyber-physical-social space. In: Proceedings of the 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2023. 4289−4294
[63]	Wang J G, Tian Y L, Wang Y T, Yang J, Wang X X, Wang S J, et al. A framework and operational procedures for metaverses-based industrial foundation models. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2037−2046 doi: 10.1109/TSMC.2022.3226755
[64]	Bi K F, Xie L X, Zhang H H, Chen X, Gu X T, Tian Q. Accurate medium-range global weather forecasting with 3D neural networks. Nature, 2023, 619(7970): 533−538 doi: 10.1038/s41586-023-06185-3
[65]	Dan Y H, Lei Z K, Gu Y Y, Li Y, Yin J H, Lin J J, et al. EduChat: A large-scale language model-based chatbot system for intelligent education. arXiv preprint arXiv: 2308.02773, 2023.
[66]	Chen Y R, Wang Z Y, Xing X F, Zheng H M, Xu Z P, Fang K, et al. BianQue-1.0: Improving the “question” ability of medical chat model through finetuning with hybrid instructions and multi-turn doctor QA datasets [Online], available: https://github.com/scutcyr/BianQue, March 28, 2024
[67]	Chen Y R, Xing X F, Lin J K, Zheng H M, Wang Z Y, Liu Q, et al. SoulChat: Improving LLMs' empathy, listening, and comfort abilities through fine-tuning with multi-turn empathy conversations. In: Proceedings of the Findings of the Association for Computational Linguistics. Singapore: ACL, 2023. 1170−1183
[68]	Zhang H B, Chen J Y, Jiang F, Yu F, Chen Z H, Chen G M, et al. HuatuoGPT, towards taming language model to be a doctor. In: Proceedings of the Findings of the Association for Computational Linguistics. Singapore: ACL, 2023. 10859−10885
[69]	Zhang X Y, Yang Q. XuanYuan 2.0: A large Chinese financial chat model with hundreds of billions parameters. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. Birmingham, UK: ACM, 2023. 4435−4439
[70]	OpenAI. Our approach to alignment research [Online], available: https://openai.com/blog/our-approach-to-alignment-research, March 28, 2024
[71]	Center for Research on Foundation Models. A holistic framework for evaluating foundation models [Online], available: https://crfm.stanford.edu/helm/lite/latest/#/, March 28, 2024
[72]	European Commission. Excellence and trust in artificial intelligence [Online], available: https://commission.europa.eu/strategy-and-policy/priorities-2019-2024/europe-fit-digital-age/excellence-and-trust-artificial-intelligence_en, March 28, 2024
[73]	Liu A W, Pan L Y, Lu Y J, Li J J, Hu X M, Zhang X, et al. A survey of text watermarking in the era of large language models. arXiv preprint arXiv: 2312.07913, 2024.
[74]	Dai J, Pan X H, Sun R Y, Ji J M, Xu X B, Liu M, et al. Safe RLHF: Safe reinforcement learning from human feedback. arXiv preprint arXiv: 2310.12773, 2023.
[75]	Zhang W E, Sheng Q Z, Alhazmi A, Li C L. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology, 2020, 11(3): Article No. 24
[76]	中央网络安全和信息化委员会办公室. 全球人工智能治理倡议 [Online], available: https://www.cac.gov.cn/2023-10/18/c_1699291032884978.htm, 2024-03-28 Office of the Central Cyberspace Affairs Commission. Global AI governance initiative [Online], available: https://www.cac.gov.cn/2023-10/18/c_1699291032884978.htm, March 28, 2024
[77]	国家互联网信息办公室, 中华人民共和国国家发展和改革委员会, 中华人民共和国教育部, 中华人民共和国科学技术部, 中华人民共和国工业和信息化部, 中华人民共和国公安部, 等. 生成式人工智能服务管理暂行办法 [Online], available: https://www.cac.gov.cn/2023-07/13/c_1690898327029107.htm, 2024-03-28 National Internet Information Office, National Development and Reform Commission, Ministry of Education of the People's Republic of China, Ministry of Science and Technology of the People's Republic of China, Ministry of Industry and Information Technology of the People's Republic of China, Ministry of Public Security of the People's Republic of China, et al. Interim measures for the management of generative artificial intelligence services [Online], available: https://www.cac.gov.cn/2023-07/13/c_1690898327029107.htm, March 28, 2024
[78]	Yu Y, Yao S Y, Li J J, Wang F Y, Lin Y L. SWDPM: A social welfare-optimized data pricing mechanism. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC). Honolulu, USA: IEEE, 2023. 2900−2906
[79]	Wang D, Wang X H, Chen L, Yao S Y, Jing M, Li H H, et al. TransWorldNG: Traffic simulation via foundation model. In: Proceedings of the IEEE 26th International Conference on Intelligent Transportation Systems (ITSC). Bilbao, Spain: IEEE, 2023. 6007−6012
[80]	Yu J R, Yu Y, Yao S Y, Wang D, Cai P L, Li H H, et al. RoW-based parallel control for mixed traffic scenario: A case study on lane-changing. In: Proceedings of the IEEE 26th International Conference on Intelligent Transportation Systems (ITSC). Bilbao, Spain: IEEE, 2023. 5397−5402
[81]	Yao S Y, Yu J R, Yu Y, Xu J, Dai X Y, Li H H, et al. Towards integrated traffic control with operating decentralized autonomous organization. In: Proceedings of the IEEE 26th International Conference on Intelligent Transportation Systems (ITSC). Bilbao, Spain: IEEE, 2023. 6126−6131
[82]	Qi H S, Yu Y, Tang Q, Hu X B. Intersection traffic deadlock formation and its probability: A petri net-based modeling approach. IET Intelligent Transport Systems, 2022, 16(10): 1342−1363 doi: 10.1049/itr2.12210
[83]	Lin Y L, Hu W, Chen X, Li S, Wang F Y. City 5.0: Towards spatial symbiotic intelligence via DAOs and parallel systems. IEEE Transactions on Intelligent Vehicles, 2023, 8(7): 3767−3770 doi: 10.1109/TIV.2023.3298903
[84]	Yu Y, Yao S Y, Wang K X, Chen Y, Wang F Y, Lin Y L. Pursuing equilibrium of medical resources via data empowerment in parallel healthcare system. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC). Honolulu, USA: IEEE, 2023. 3186−3191
[85]	Yu Y, Cui Y L, Zeng J Q, He C G, Wang D H. Identifying traffic clusters in urban networks based on graph theory using license plate recognition data. Physica A: Statistical Mechanics and Its Applications, 2022, 591: Article No. 126750 doi: 10.1016/j.physa.2021.126750
[86]	Lin Y L, Na X X, Wang D, Dai X Y, Wang F Y. Mobility 5.0: Smart logistics and transportation services in cyber-physical-social systems. IEEE Transactions on Intelligent Vehicles, 2023, 8(6): 3527−3532 doi: 10.1109/TIV.2023.3286995
[87]	Xu J, Yao S Y, Yu Y, Wang F Y, Lin Y L. DeMaaS: Efficient service distribution for MaaS via decentralized collaboration and optimization. In: Proceedings of the IEEE 26th International Conference on Intelligent Transportation Systems (ITSC). Bilbao, Spain: IEEE, 2023. 5391−5396
[88]	Li L, Wang X, Wang K F, Lin Y L, Xin J M, Chen L, et al. Parallel testing of vehicle intelligence via virtual-real interaction. Science Robotics, 2019, 4(28): Article No. eaaw4106 doi: 10.1126/scirobotics.aaw4106
[89]	Zhao Y, Hu C, Zhu Z Q, Qiu S H, Chen B, Jiao P, et al. Crowd sensing intelligence for ITS: Participants, methods, and stages. IEEE Transactions on Intelligent Vehicles, 2023, 8(6): 3541−3546 doi: 10.1109/TIV.2023.3284046
[90]	Zhang J P, Pu J, Xue J R, Yang M, Xu X, Wang X, et al. HiVeGPT: Human-machine-augmented intelligent vehicles with generative pre-trained transformer. IEEE Transactions on Intelligent Vehicles, 2023, 8(3): 2027−2033 doi: 10.1109/TIV.2023.3256982
[91]	刘昕, 王晓, 张卫山, 汪建基, 王飞跃. 平行数据: 从大数据到数据智能. 模式识别与人工智能, 2017, 30(8): 673−681 Liu Xin, Wang Xiao, Zhang Wei-Shan, Wang Jian-Ji, Wang Fei-Yue. Parallel data: From big data to data intelligence. Pattern Recognition and Artificial Intelligence, 2017, 30(8): 673−681
[92]	Li X, Tian Y L, Ye P J, Duan H B, Wang F Y. A novel scenarios engineering methodology for foundation models in metaverse. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(4): 2148−2159 doi: 10.1109/TSMC.2022.3228594
[93]	王飞跃, 王艳芬, 陈薏竹, 田永林, 齐红威, 王晓, 等. 联邦生态: 从联邦数据到联邦智能. 智能科学与技术学报, 2020, 2(4): 305−311 Wang Fei-Yue, Wang Yan-Fen, Chen Yi-Zhu, Tian Yong-Lin, Qi Hong-Wei, Wang Xiao, et al. Federated ecology: From federated data to federated intelligence. Chinese Journal of Intelligent Science and Technology, 2020, 2(4): 305−311
[94]	朱静, 王飞跃, 王戈, 田永林, 袁勇, 王晓, 等. 联邦控制: 面向信息安全和权益保护的分布式控制方法. 自动化学报, 2021, 47(8): 1912−1920 Zhu Jing, Wang Fei-Yue, Wang Ge, Tian Yong-Lin, Yuan Yong, Wang Xiao, et al. Federated control: A distributed control approach towards information security and rights protection. Acta Automatica Sinica, 2021, 47(8): 1912−1920
[95]	Wang F Y, Qin R, Li J J, Wang X, Qi H W, Jia X F, et al. Federated management: Toward federated services and federated security in federated ecology. IEEE Transactions on Computational Social Systems, 2021, 8(6): 1283−1290 doi: 10.1109/TCSS.2021.3125312
[96]	Miao Q H, Zheng W B, Lv Y S, Huang M, Ding W W, Wang F Y. DAO to HANOI via DeSci: AI paradigm shifts from AlphaGo to ChatGPT. IEEE/CAA Journal of Automatica Sinica, 2023, 10(4): 877−897 doi: 10.1109/JAS.2023.123561
[97]	Wang F Y. The DAO to MetaControl for metasystems in metaverses: The system of parallel control systems for knowledge automation and control intelligence in CPSS. IEEE/CAA Journal of Automatica Sinica, 2022, 9(11): 1899−1908 doi: 10.1109/JAS.2022.106022
[98]	Zhao Y, Zhu Z Q, Chen B, Qiu S H, Huang J C, Lu X, et al. Toward parallel intelligence: An interdisciplinary solution for complex systems. The Innovation, 2023, 4(6): Article No. 100521 doi: 10.1016/j.xinn.2023.100521
[99]	Yang J, Wang X, Tian Y L, Wang X, Wang F Y. Parallel intelligence in CPSSs: Being, becoming, and believing. IEEE Intelligent Systems, 2023, 38(6): 75−80 doi: 10.1109/MIS.2023.3284694
[100]	Li X, Ye P J, Li J J, Liu Z M, Cao L B, Wang F Y. From features engineering to scenarios engineering for trustworthy AI: I&I, C&C, and V&V. IEEE Intelligent Systems, 2022, 37(4): 18−26 doi: 10.1109/MIS.2022.3197950
[101]	王飞跃. 平行管理: 复杂性管理智能的生态科技与智慧管理之DAO. 自动化学报, 2022, 48(11): 2655−2669 Wang Fei-Yue. Parallel management: The DAO to smart ecological technology for complexity management intelligence. Acta Automatica Sinica, 2022, 48(11): 2655−2669
[102]	Li J J, Qin R, Wang F Y. The future of management: DAO to smart organizations and intelligent operations. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023, 53(6): 3389−3399 doi: 10.1109/TSMC.2022.3226748
[103]	杨静, 王晓, 王雨桐, 刘忠民, 李小双, 王飞跃. 平行智能与CPSS: 三十年发展的回顾与展望. 自动化学报, 2023, 49(3): 614−634 Yang Jing, Wang Xiao, Wang Yu-Tong, Liu Zhong-Min, Li Xiao-Shuang, Wang Fei-Yue. Parallel intelligence and CPSS in 30 years: An ACP approach. Acta Automatica Sinica, 2023, 49(3): 614−634
[104]	Wang X X, Yang J, Wang Y T, Miao Q H, Wang F Y, Zhao A J, et al. Steps toward industry 5.0: Building “6S” parallel industries with cyber-physical-social intelligence. IEEE/CAA Journal of Automatica Sinica, 2023, 10(8): 1692−1703 doi: 10.1109/JAS.2023.123753
[105]	Wang Y T, Wang X, Wang X X, Yang J, Kwan O, Li L X, et al. The ChatGPT after: Building knowledge factories for knowledge workers with knowledge automation. IEEE/CAA Journal of Automatica Sinica, 2023, 10(11): 2041−2044 doi: 10.1109/JAS.2023.123966
[106]	Wang F Y, Yang J, Wang X X, Li J J, Han Q L. Chat with ChatGPT on industry 5.0: Learning and decision-making for intelligent industries. IEEE/CAA Journal of Automatica Sinica, 2023, 10(4): 831−834 doi: 10.1109/JAS.2023.123552