Iterative Adaptive Dynamic Programming Approach to Power Optimal Control for Smart Grid with Energy Storage Devices
-
摘要: 智能电网是新一代电网建设的目标,也是国际电力工业界的共同选择. 本文研究在储能设备接入电网情况下,建立一套基于自适应动态规划(Adaptive dynamic programming,ADP)的智能电网电能自适应优化控制的理论与方法,实现电网发电端以及用户端的智能交互,开辟对智能电网供需优化匹配与调控方法的新途径. 论文首先给出动态规划的最优性原理以及带有储能设备智能电网的运行方式并提出优化目标;然后,设计新型迭代自适应动态规划方法实现对储能 设备的最优控制,并证明自适应动态规划方法的收敛性,在理论上保证了对智能电网电能的优化;最后,给出仿真例子显示出所提出控制方法的有效性.Abstract: The smart grid is a new generation of power grids, and also the common choice of the international power industry. This paper aims to establish a new adaptive optimal control theory and a set of methods based on adaptive dynamic programming (ADP) for a smart grid with energy storage devices. The intelligent interactions between the power generation side and the clients can be finally achieved to create a new way of optimal matching of the supply and demand for the smart grid. First, the optimality principle of dynamic programming for the grid with energy storage devices is given, and optimization objective is then presented. Then a new iterative adaptive dynamic programming method is developed to achieve the optimal control of energy storage devices, and convergence of the adaptive dynamic programming method is also proved. Finally, a simulation example is given to show the effectiveness of the method.
-
[1] Ma Qi-Yan, Qin Li-Jun. Key technologies of smart distribution grid. Modem Electric Power, 2010, 27(2): 39-44(马其燕, 秦立军. 智能配电网关键技术. 现代电力, 2010, 27(2): 39-44) [2] Gellings C W. The Smart Grid: Enabling Energy Efficiency and Demand Response. Lilburn: The Fairmont Press, Inc., 2009. [3] Zhen Xiao-Ya, Yin Zhong-Dong, Sun Zhou. Advanced energy storage technology in the application of the smart grid and its prospect. Electric Age, 2011, (1): 44-47(甄晓亚, 尹忠东, 孙舟. 先进储能技术在智能电网中的应用和展望. 电气时代, 2011, (1): 44-47) [4] Xu Yan-Wei, Jia Rong. Application of artificial immune theory-based ant colony system (AIACS) in reconfiguration of distribution networks. Power System Protection and Control, 2010, 38(18): 89-93(徐延炜, 贾嵘. 基于人工免疫思想的蚁群算法(AIACS)在配电网重构中的应用. 电力系统保护与控制, 2010, 38(18): 89-93) [5] Hung M H, Shu L S, Ho S J, Hwang S F, Ho S Y. A novel intelligent multiobjective simulated annealing algorithm for designing robust PID controllers. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2010, 38(2): 319-330 [6] Green R C, Wang L F, Alam M, Singh C. Intelligent and parallel state space pruning for power system reliability analysis using MPI on a multicore platform. IEEE PES Innovative Smart Grid Technologies (ISGT), 2011, 18(2): 1-8 [7] Qi Fang, Zhang Li-Zi, Wei Bin, Que Guang-Hui. Study on electricity tariffs based on Ramsey pricing theory. Power Demand Side Management, 2010, 12(2): 24-27(齐放, 张粒子, 魏玢, 阙光辉. 基于拉姆齐定价理论的销售电价研究. 电力需求侧管理, 2010, 12(2): 24-27) [8] Zhang Hua-Guang, Zhang Xin, Luo Yan-Hong, Yang Jun. An overview of research on adaptive dynamic programming. Acta Automatica Sinica, 2013, 39(4): 303-311(张化光, 张欣, 罗艳红, 杨珺. 自适应动态规划综述. 自动化学报, 2013, 39(4): 303-311) [9] Powell W B. Approximate Dynamic Programming: Solving the Curses of Dimensionality. New York: John Wiley & Sons, 2007. [10] Werbos P J. Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (Chapter 13). New York: Van Nostrand Reinhold, 1992. [11] Wang F Y, Zhang H G, Liu D R. Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine, 2009, 4(2): 39-47 [12] Liu D R, Zhang Y, Zhang H G. A self-learning call admission control scheme for CDMA cellular networks. IEEE Transactions on Neural Networks, 2005, 16(5): 1219-1228 [13] Zhang H G, Wei Q L, Luo Y H. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2008, 38(4): 937-942 [14] Zhang H G, Wei Q L, Liu D R. An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games. Automatica, 2011, 47(1): 207-214 [15] Heydari A, Balakrishnan S N. Finite-horizon control-constrained nonlinear optimal control using single network adaptive critics. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(1): 145-157 [16] Zhang H G, Luo Y H, Liu D R. Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints. IEEE Transactions on Neural Networks, 2009, 20(9): 1490-1503 [17] Zhao Dong-Bin, Liu De-Rong, Yi Jian-Qiang. An overview on the adaptive dynamic programming based urban city traffic signal optimal control. Acta Automatica Sinica, 2009, 35(6): 676-681(赵冬斌, 刘德荣, 易建强. 基于自适应动态规划的城市交通信号优化控制方法综述. 自动化学报, 2009, 35(6): 676-681) [18] Hou Zhong-Sheng, Xu Jian-Xin. On data-driven control theory: the state of the art and perspective. Acta Automatica Sinica, 2009, 35(6): 650-667(侯忠生, 许建新. 数据驱动控制理论及方法的回顾和展望. 自动化学报, 2009, 35(6): 650-667) [19] Hou Zhong-Sheng. On model-free adaptive control: the state of the art and perspective. Control Theory & Applications, 2006, 23(4): 586-592(侯忠生. 无模型自适应控制的现状与展望. 控制理论与应用, 2006, 23(4): 586-592) [20] Lewis F L, Liu D R. Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. New York: John Wiley & Sons, 2013. [21] Liu De-Rong, Li Hong-Liang, Wang Ding. Data-based self-learning optimal control: research progress and prospects. Acta Automatica Sinica, 2013, 39(11): 1858-1870(刘德荣, 李宏亮, 王鼎. 基于数据的自学习优化控制: 研究进展与展望. 自动化学报, 2013, 39(11): 1858-1870) [22] Zhang T P, Lu Y, Zhu Q, Shen Q K. Adaptive dynamic surface control with unmodeled dynamics. In: Proceedings of the 31st Chinese Control Conference (CCC). Hefei, China: IEEE, 2012. 2859-2864 [23] He Yue-Bang, Pei Hai-Long, Ye Xiang, Zhang Qian. Trajectory tracking control of unmanned helicopters by using adaptive dynamic surface approach. Journal of South China University of Technology (Natural Science Edition), 2013, 41(5): 1-8(贺跃帮, 裴海龙, 叶祥, 张谦. 无人直升机的自适应动态面轨迹跟踪控制. 华南理工大学学报(自然科学版), 2013, 41(5): 1-8) [24] Huang T, Liu D R. A self-learning scheme for residential energy system control and management. Neural Computing and Applications, 2013, 22(2): 259-269 [25] Kirk D E. Optimal Control Theory: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1970.
点击查看大图
计量
- 文章访问数: 2560
- HTML全文浏览量: 76
- PDF下载量: 1485
- 被引次数: 0