Enhancing ε-support Vector Regression with Gradient Information
-
摘要: 传统的ε-支持向量回归机(ε-support vector regression, ε-SVR)只是根据样本点处的响应值来构建模型, 并没考虑样本点处的梯度信息. 如果样本点处的梯度信息容易获得或者获得的成本并不高, 那就应该将梯度信息应用到模型的构建中. 已有的基于梯度信息的 ε-支持向量回归机模型的构建是从泰勒展开的角度着手, 简单地将梯度信息插入到泰勒展开式中; 本研究另辟蹊径, 并没有去估计样本点邻域内的函数值, 而是将梯度信息作为第二类变量融入到核矩阵中直接构建优化模型, 使模型的构建更为简捷直观, 并据此得到一种新的基于梯度信息的 ε-支持向量回归机(Gradient-enhanced ε-support vector regression, GESVR) 模型. 所提模型通过了常用分析函数及精算领域中的生命表数据的验证, 实验表明, 与传统的 ε-SVR相比, 考虑梯度信息的GESVR模型显著地提高了其预测精度.Abstract: Traditional methods constructing of ε-support vector regression (ε-SVR) do not consider the gradients of the true function but only deal with the exact responses at the samples. If the gradient information is available easily and cheaply, it should be used to enhance the model. The existing research on constructing of ε-SVR with gradient information starts from the perspective of Taylor expansion, and simply inserts the additional objective values in the neighborhood of the sampled points into the corresponding terms of a Taylor expansion. In this paper, the gradient-enhanced ε-support vector regression (GESVR) is developed with a direct formulation by incorporating the gradient information into the kernel matrix. The efficiency of this technique is verified by analytical function fitting and the actuarial data in the life table. The results show that the GESVR provides more reliable prediction results than ε-SVR alone.
-
[1] Smola A J, Schölkopf B. A tutorial on support vector regression. Statistics and Computing, 2004, 14(3): 199-222 [2] Tao Jian-Wen, Wang Shi-Tong. Kernel distribution consistency based local domain adaptation learning. Acta Automatica Sinica, 2013, 39(8): 1295-1309(陶剑文, 王士同. 核分布一致局部领域适应学习. 自动化学报, 2013, 39(8): 1295-1309) [3] Liang Yan-Ming, Su Fang, Li Qi, Liu Ding. A self-organizing algorithm for T-S fuzzy model based on support vector machine regression and its application. Acta Automatica Sinica, 2013, 39(12): 2143-2149(梁炎明, 苏芳, 李琦, 刘丁. 基于支持向量机回归的T-S模糊模型自组织算法及应用. 自动化学报, 2013, 39(12): 2143-2149) [4] Yang Zhi-Min, Shao Yuan-Hai, Liang Jing. Unascertained support vector machine. Acta Automatica Sinica, 2013, 39(6): 895-901(杨志民, 邵元海, 梁静. 未确知支持向量机. 自动化学报, 2013, 39(6): 895-901) [5] Zhou Xiao-Jian, Ma Yi-Zhong, Zhu Jia-Gang. Gradient-enhance support vector regression. Systems Engineering, 2010, 28(3): 87-92 (周晓剑, 马义中, 朱嘉钢. 基于梯度信息的支持向量回归机. 系统工程, 2010, 28(3): 87-92) [6] Alexander I, Forrester J, Keane A J. Recent advances in surrogate-based optimization. Progress in Aerospace Sciences, 2009, 45(1-3): 50-79 [7] Zhou X J, Ma Y Z, Li X F. Ensemble of surrogates with recursive arithmetic average. Structural and Multidisciplinary Optimization, 2011, 44(5): 651-671
计量
- 文章访问数: 1632
- HTML全文浏览量: 54
- PDF下载量: 1018
- 被引次数: 0