2.765

2022影响因子

(CJCR)

  • 中文核心
  • EI
  • 中国科技核心
  • Scopus
  • CSCD
  • 英国科学文摘

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于自适应LASSO先验的稀疏贝叶斯学习算法

白宗龙 师黎明 孙金玮

白宗龙, 师黎明, 孙金玮. 基于自适应LASSO先验的稀疏贝叶斯学习算法. 自动化学报, 2022, 48(5): 1193−1208 doi: 10.16383/j.aas.c210022
引用本文: 白宗龙, 师黎明, 孙金玮. 基于自适应LASSO先验的稀疏贝叶斯学习算法. 自动化学报, 2022, 48(5): 1193−1208 doi: 10.16383/j.aas.c210022
Bai Zong-Long, Shi Li-Ming, Sun Jin-Wei. Sparse Bayesian learning using adaptive LASSO priors. Acta Automatica Sinica, 2022, 48(5): 1193−1208 doi: 10.16383/j.aas.c210022
Citation: Bai Zong-Long, Shi Li-Ming, Sun Jin-Wei. Sparse Bayesian learning using adaptive LASSO priors. Acta Automatica Sinica, 2022, 48(5): 1193−1208 doi: 10.16383/j.aas.c210022

基于自适应LASSO先验的稀疏贝叶斯学习算法

doi: 10.16383/j.aas.c210022
基金项目: 中央高校基本科研业务费项目 (IR2021222) 资助
详细信息
    作者简介:

    白宗龙:哈尔滨工业大学仪器科学与工程学院博士研究生. 主要研究方向为稀疏信号恢复, 麦克风阵列信号处理. E-mail: baizongyao@163.com

    师黎明:奥尔堡大学建筑设计与媒体艺术系博士后. 主要研究方向为稀疏信号处理, 语音信号处理. E-mail: ls@create.aau.dk

    孙金玮:哈尔滨工业大学仪器科学与工程学院教授. 主要研究方向为生物信号处理, 主动噪声控制. 本文通信作者. E-mail: jwsun@hit.edu.cn

Sparse Bayesian Learning Using Adaptive LASSO Priors

Funds: Supported by the Fundamental Research Funds for the Central Universities (IR2021222)
More Information
    Author Bio:

    BAI Zong-Long Ph.D. candidate at the School of Instrument Science and Engineering, Harbin Institute of Technology. His research interest covers sparse signal recovery technology, microphone array signal processing

    SHI Li-Ming Postdoctoral at the Create, Aalborg University. His research interest covers sparse signal recovery technology, speech signal processing

    SUN Jin-Wei Professor at the School of Instrument Science and Engineering, Harbin Institute of Technology. His research interest covers biomedical signal processing, active noise control. Corresponding author of this paper

  • 摘要: 为了提高稀疏信号恢复的准确性, 开展了基于自适应套索算子(Least absolute shrinkage and selection operator, LASSO)先验的稀疏贝叶斯学习(Sparse Bayesian learning, SBL)算法研究. 1) 在稀疏贝叶斯模型构建阶段, 构造了一种新的多层贝叶斯框架, 赋予信号中元素独立的LASSO先验. 该先验比现有稀疏先验更有效地鼓励稀疏并且该模型中所有参数更新存在闭合解. 然后在该多层贝叶斯框架的基础上提出了一种基于自适应LASSO先验的SBL算法. 2) 为降低提出的算法的计算复杂度, 在贝叶斯推断阶段利用空间轮换变元方法对提出的算法进行改进, 避免了矩阵求逆运算, 使参数更新快速高效, 从而提出了一种基于自适应LASSO先验的快速SBL算法. 本文提出的算法的稀疏恢复性能通过实验进行了验证, 分别针对不同大小测量矩阵的稀疏信号恢复以及单快拍波达方向(Direction of arrival, DOA)估计开展了实验. 实验结果表明: 提出基于自适应LASSO先验的SBL算法比现有算法具有更高的稀疏恢复准确度; 提出的快速算法的准确度略低于提出的基于自适应LASSO先验的SBL算法, 但计算复杂度明显降低.
    1)  1 Oracle特性具体包括模型选择相和性和参数估计渐进正态性. 其含义为, 在一些变量不是提前已知的情况下, 如果算法具有Oracle特性, 那么它能够筛选出正确的预测的概率为1而且能够有效而正确地估计非零估计量.
  • 图  1  基于自适应LASSO先验的SBL框架的因子图

    Fig.  1  The factor graph of the proposed SBL framework using adaptive LASSO priors

    图  2  四种算法的稀疏先验代价函数二维等高线图

    Fig.  2  Two dimensional contour plots of cost functions of different sparse priors

    图  3  本算法在不同参数下稀疏先验代价函数二维等高线图

    Fig.  3  Two dimensional contour plots of cost functions of the proposed sparse priors versus hyperparameters

    图  4  一维信号稀疏恢复图

    Fig.  4  Results for one-dimensional signal recovery

    图  5  实值模型下各算法稀疏恢复准确度与测量数的关系

    Fig.  5  RMSE of different algorithms with the real-value signal model versus length of measurements

    图  6  复值模型下各算法稀疏恢复准确度与测量数的关系

    Fig.  6  RMSE of different algorithms with the complex-value signal model versus length of measurements

    图  7  高维实值信号模型下各算法稀疏恢复准确度与测量数的关系

    Fig.  7  RMSE of different algorithms with the high-dimensional real-value signal model versus length of measurements

    图  8  高维复值信号模型下各算法稀疏恢复准确度与测量数的关系

    Fig.  8  RMSE of different algorithms with the high-dimensional complex-value signal model versus length of measurements

    图  9  实值模型下各算法稀疏恢复准确度与稀疏度的关系

    Fig.  9  RMSE of different algorithms with the real-value signal model versus number of non-zero elements

    图  10  复值模型下各算法稀疏恢复准确度与稀疏度的关系

    Fig.  10  RMSE of different algorithms with the complex-value signal model versus number of non-zero elements

    图  11  高维实值信号模型下各算法稀疏恢复准确度与稀疏度的关系

    Fig.  11  RMSE of different algorithms with the high-dimensional real-value signal model versus number of non-zero elements

    图  12  高维复值信号模型下各算法稀疏恢复准确度与稀疏度的关系

    Fig.  12  RMSE of different algorithms with the high-dimensional complex-value signal model versus number of non-zero elements

    图  13  实值模型下各算法稀疏恢复准确度与信噪比的关系

    Fig.  13  RMSE of different algorithms versus SNR with the real-value signal model

    图  14  复值模型下各算法稀疏恢复准确度与信噪比的关系

    Fig.  14  RMSE of different algorithms versus SNR with the complex-value signal model

    图  15  高维实值信号模型下各算法稀疏恢复准确度与信噪比的关系

    Fig.  15  RMSE of different algorithms versus SNR with the high-dimensional real-value signal model

    图  16  高维复值信号模型下各算法稀疏恢复准确度与信噪比的关系

    Fig.  16  RMSE of different algorithms versus SNR with the high-dimensional complex-value signal model

    图  17  DOA估计的准确度与测量数的关系

    Fig.  17  RMSE of DOA estimation using different algorithms versus number of measurements

    图  18  DOA估计准确度与信噪比的关系

    Fig.  18  RMSE of DOA estimation using different algorithms versus SNR

    表  1  各算法单次运行时间

    Table  1  Time consumptions of different algorithms

    实值信号模型 复值信号模型
    算法 用时(s) 算法 用时(s)
    FastLaplace 0.11 FastSBL 1.54
    aLASSO 1.94 GAMP-SBL 0.51
    FastSBL 0.40 MFOCUSS 0.21
    GAMP-SBL 0.07 HSL-SBL 3.16
    FaLASSO-SBL 0.26 FaLASSO-SBL 0.74
    aLASSO-SBL 0.98 aLASSO-SBL 2.33
    下载: 导出CSV

    表  2  恢复高维信号时各算法单次运行时间

    Table  2  Time consumptions of different algorithms when the dimension of signal is high

    实值信号模型 复值信号模型
    算法 用时(s) 算法 用时(s)
    FastLaplace 0.83 FastSBL 6.95
    aLASSO 5.71 GAMP-SBL 2.17
    FastSBL 3.40 MFOCUSS 2.86
    GAMP-SBL 0.69 HSL-SBL 15.73
    FaLASSO-SBL 1.06 FaLASSO-SBL 4.61
    aLASSO-SBL 8.38 aLASSO-SBL 17.41
    下载: 导出CSV

    表  3  单快拍DOA估计实验各算法单次运行时间

    Table  3  Time consumptions of different algorithms for single snapshot DOA estimation

    算法 用时(s) 算法 用时(s)
    SS-ESPRIT 0.37 HSL-SBL 0.85
    SURE-IR 1.64 FaLASSO-SBL 0.47
    L1-SR 0.91 aLASSO-SBL 0.83
    OGSBL 0.69
    下载: 导出CSV
  • [1] Wang L, Zhao L F, Bi G A,, Wan C R, Zhang L R, Zhang H J. Novel wideband DOA estimation based on sparse Bayesian learning with dirichlet process priors. IEEE Transactions on Signal Processing. 2016, 64(2): 275-289. doi: 10.1109/TSP.2015.2481790
    [2] Xenaki A, Boldt J B, Christensen M G. Sound source localization and speech enhancement with sparse Bayesian learning beamforming. The Journal of the Acoustical Society of America. 2018, 143(6): 3912-3921 doi: 10.1121/1.5042222
    [3] Bai Z L, Sun J W, Jensen J R, Christensen M G. Indoor sound source localization based on sparse Bayesian learning and compressed data. In: Proceedings of the 27th European Signal Processing Conference. A Coruna, Spain: IEEE, 2019. 1−5
    [4] Zheng Y L, Fraysse A, Rodet T. Efficient variational Bayesian approximation method based on subspace optimization. IEEE Transactions on Image Processing. 2015, 24(2): 681-693 doi: 10.1109/TIP.2014.2383321
    [5] 兰诚栋, 林宇鹏, 方大锐, 陈建. 多视点稀疏测量的图像绘制方法. 自动化学报, 2021, 47(4): 882-890

    Lan Cheng-Dong, Lin Yu-Peng, Fang Da-Rui, Chen Jian. Multi-view sparse measurement for image-based rendering method. Acta Automatica Sinica. 2021, 47(4): 882-890
    [6] Zhang M C, Yuan X J, He Z Q. Variance state propagation for structured sparse Bayesian learning. IEEE Transactions on Signal Processing. 2020, 68: 2386-2400 doi: 10.1109/TSP.2020.2983827
    [7] Liu S H, Huang Y M, Wu H, Tan C, Jia J B. Efficient multitask structure-aware sparse Bayesian learning for frequency-difference electrical impedance tomography. IEEE Transactions on Industrial Informatics. 2021, 17(1): 463-472 doi: 10.1109/TII.2020.2965202
    [8] 郭俊锋, 李育亮. 基于学习字典的机器人图像稀疏表示方法. 自动化学报, 2020, 46(4): 820-830

    Guo Jun-Feng, Li Yu-Liang. Sparse representation of robot image based on dictionary learning algorithm. Acta Automatica Sinica. 2020, 46(4): 820-830
    [9] 张芳, 王萌, 肖志涛, 吴骏, 耿磊, 童军, 王雯. 基于全卷积神经网络与低秩稀疏分解的显著性检测. 自动化学报, 2019, 45(11): 2148-2158

    Zhang Fang, Wang Meng, Xiao Zhi-Tao, Wu Jun, Geng Lei, Tong Jun, Wang Wen. Saliency detection via full convolution neural network and low rank sparse decomposition. Acta Automatica Sinica. 2019, 45(11): 2148-2158
    [10] Ojeda A, Kenneth K D, Mullen T. Fast and robust block-sparse Bayesian learning for EEG source imaging. NeuroImage. 2018, 174: 449-462 doi: 10.1016/j.neuroimage.2018.03.048
    [11] Jiao Y, Zhang Y, Chen X, Yin E W, Jin J, Wang X Y, Cichocki A. Sparse group representation model for motor imagery EEG classification. IEEE Journal of Biomedical and Health Informatics. 2019, 23(2): 631-641 doi: 10.1109/JBHI.2018.2832538
    [12] Niu H Q, Gerstoft P, Ozanich E, Li Z L, Zhang R H, Gong Z X, Wang H B. Block sparse Bayesian learning for broadband mode extraction in shallow water from a vertical array. The Journal of the Acoustical Society of America 2020, 147(6): 3729-3739 doi: 10.1121/10.0001322
    [13] Zheng R, Xu X, Ye Z F, Dai J S. Robust sparse Bayesian learning for DOA estimation in impulsive noise environments. Signal Processing. 2020, 171(107500): 1-6
    [14] 曹娜, 王永利, 孙建红, 赵宁, 宫小泽. 基于字典学习和拓展联合动态稀疏表示的SAR目标识别. 自动化学报, 2020, 46(12): 2638-2646

    CAO Na, WANG Yong-Li, SUN Jian-Hong, ZHAO Ning, GONG Xiao-Ze. SAR target recognition based on dictionary learning and extended joint dynamic sparse representation. Acta Automatica Sinica. 2020, 46(12): 2638-2646
    [15] Yang Z, Li J, Stoica P, Xie L H. Sparse methods for direction-of-arrival estimation. Academic Press Library in Signal Processing. London: Academic Press, 2018. 509-581
    [16] Tipping M E, Smola A. Sparse Bayesian learning and the relevance vector machine. The Journal of Machine Learning Research. 2001, 59(1): 211-244
    [17] Babacan S D, Molina R, Katsaggelos A K. Bayesian compressive sensing using laplace priors. IEEE Transactions on Image Processing. 2010, 19(1): 53-63 doi: 10.1109/TIP.2009.2032894
    [18] Zhao L F, Wang L, Bi G A, Yang L. An autofocus technique for high-resolution inverse synthetic aperture radar imagery. IEEE Transactions on Geoscience and Remote Sensing. 2014, 52(10): 6392-6403 doi: 10.1109/TGRS.2013.2296497
    [19] Yang J, Yang Y. Sparse Bayesian DOA estimation using hierarchical synthesis lasso priors for off-grid signals. IEEE Transactions on Signal Processing. 2020, 68: 872-884 doi: 10.1109/TSP.2020.2967665
    [20] Zou H. The adaptive lasso and its oracle properties. Journal of the American Statistical Association. 2006, 101(476): 1418-1429 doi: 10.1198/016214506000000735
    [21] Tipping M E, Faul A C. Fast marginal likelihood maximisation for sparse Bayesian models. In: Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics. Florida, USA: Springer, 2003. 3−6
    [22] Duan H, Yang L, Fang J, Li H. Fast inverse-free sparse Bayesian learning via relaxed evidence lower bound maximization. IEEE Signal Processing Letters. 2017, 24(6): 774-778 doi: 10.1109/LSP.2017.2692217
    [23] Shoukairi M A, Rao B D. Sparse Bayesian learning using approximate message passing. In: Proceedings of the 48th Asilomar Conference on Signals, Systems and Computers. Pacific Grove, USA: IEEE, 2014. 1957−1961
    [24] Shoukairi M A, Schniter P, Rao B D. A gamp-based low complexity sparse Bayesian learning algorithm. IEEE Transactions on Signal Processing. 2018, 66(2): 294-308 doi: 10.1109/TSP.2017.2764855
    [25] Thomas C K, Slock D. Save - space alternating variational estimation for sparse Bayesian learning. In: Proceedings of IEEE Data Science Workshop. Lausanne, Switzerland: IEEE, 2018. 11−15
    [26] Worley B. Scalable mean-field sparse Bayesian learning. IEEE Transactions on Signal Processing. 2019, 67(24): 6314-6326 doi: 10.1109/TSP.2019.2954504
    [27] Candes E J, Romberg J, Tao T. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory. 2006, 52(2): 489-509 doi: 10.1109/TIT.2005.862083
    [28] Wipf D P, Rao B D, Nagarajan S. Latent variable Bayesian models for promoting sparsity. IEEE Transactions on Information Theory. 2011, 57(9): 6236-6255 doi: 10.1109/TIT.2011.2162174
    [29] Figueiredo M A T, Nowak R D, Wright S J. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing. 2007, 1(4): 586-597 doi: 10.1109/JSTSP.2007.910281
    [30] Xenaki A, Gerstoft P, Mosegaard K. Compressive beamforming. Journal of the Acoustical Society of America. 2014, 136(1): 260-271 doi: 10.1121/1.4883360
    [31] Bishop C M. Pattern recognition and machine learning. New York, USA: Springer-Verlag, 2006. 152−169
    [32] Tzikas D G, Likas A C, Galatsanos N P. The variational approximation for Bayesian inference. IEEE Signal Processing Magazine. 2008, 25(6): 131-146 doi: 10.1109/MSP.2008.929620
    [33] Higham N J. Accuracy and stability of numerical algorithms. Society for Industrial and Applied Mathematics. Philadelphia, USA: Springer, 2002. 67−93
    [34] Pati Y C, Rezaiifar R, Krishnaprasad P S. Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In: Proceesdings of the Conference on Signals, Systems and Computers. Pacific Grove, USA: IEEE, 2002. 1−5
    [35] Cotter S F, Rao B D, Engan K, Delgado K K. Sparse solutions to linear inverse problems with multiple measurement vectors. IEEE Transactions on Signal Processing. 2005, 53(7): 2477-2488 doi: 10.1109/TSP.2005.849172
    [36] Thakre A, Haardt M, Giridhar K. Single snapshot spatial smoothing with improved effective array aperture. IEEE Signal Processing Letters. 2009, 16(6): 505-508 doi: 10.1109/LSP.2009.2017573
    [37] Raj A G, Mcclellan J H. Single snapshot super-resolution DOA estimation for arbitrary array geometries. IEEE Signal Processing Letters. 2019, 26(1): 119-123 doi: 10.1109/LSP.2018.2881927
    [38] Fang J, Wang F, Shen Y, Li H, Blum R S. Super-resolution compressed sensing for line spectral estimation: An iterative reweighted approach. IEEE Transactions on Signal Processing. 2016, 64(18): 4649-4662 doi: 10.1109/TSP.2016.2572041
    [39] Yang Z, Xie L H, Zhang C. Off-grid direction of arrival estimation using sparse Bayesian inference. IEEE Transactions on Signal Processing. 2013, 61(1): 38-43 doi: 10.1109/TSP.2012.2222378
  • 加载中
图(18) / 表(3)
计量
  • 文章访问数:  1594
  • HTML全文浏览量:  865
  • PDF下载量:  340
  • 被引次数: 0
出版历程
  • 收稿日期:  2021-01-12
  • 录用日期:  2021-04-29
  • 网络出版日期:  2021-06-16
  • 刊出日期:  2022-05-13

目录

    /

    返回文章
    返回