您的位置:山东大学 -> 科技期刊社 -> 《山东大学学报(理学版)》

《山东大学学报(理学版)》 ›› 2018, Vol. 53 ›› Issue (12): 90-98.doi: 10.6040/j.issn.1671-9352.0.2017.627

• • 上一篇    下一篇

求解具有约束的l1-范数问题的神经网络模型

李翠平,高兴宝*   

  1. 陕西师范大学数学与信息科学学院, 陕西 西安 710062
  • 出版日期:2018-12-20 发布日期:2018-12-18
  • 作者简介:李翠平(1982— ), 女, 博士研究生, 讲师, 研究方向为最优化方法(神经网络模型). E-mail:cuipli@126.com*通信作者简介:高兴宝(1966— ), 男, 博士, 教授, 博士生导师, 研究方向为智能优化方法、最优化理论与算法. E-mail:xinbaog@snnu.edu.cn
  • 基金资助:
    国家自然科学基金资助项目(61273311,61603235)

A neural network for solving l1-norm problems with constraints

LI Cui-ping, GAO Xing-bao*   

  1. School of Mathematics and Information Science, Shaanxi Normal University, Xian 710062, Shaanxi, China
  • Online:2018-12-20 Published:2018-12-18

摘要: 提出了一个解约束最小 l1-范数问题的单层神经网络模型。与已有神经网络模型相比,提出的模型所需神经元数少且层数少。通过引入 Lyapunov 函数,证明了该模型的稳定性和收敛性。数值试验结果表明所提出的模型具有良好的性能。

关键词: l1-范数问题, 神经网络, 单层, 稳定性

Abstract: This paper presents a one-layer neural network model for solving l1-norm problems with constraints. Compared with some existing neural network models, the proposed model needs fewer neurons and has a simpler structure. The stability and convergence of the proposed model are proved by introducing a Lyapunov function. Some simulation examples are used to illustrate its validity and transient behaviors.

Key words: l1-norm problem, neural network, one-layer, stability

中图分类号: 

  • O241.6
[1] KINDERLEHRER D, STAMPACCHIA G. An introduction to variational inequalities and their applications[M]. Salt Lake City: Academic Press, 1980.
[2] ORTEGA J M, RHEINBOLDT W C. Iterative solution of nonlinear equation in several variables[M]. New York: Academic Press, 1970.
[3] SOLODOV M V, TSENG P. Modified projection-type methods for monotone variational inequalities[J]. SIAM Journal on Control and Optimization, 1996, 34(5): 1814-1830.
[4] TSENG P. A modified forward-backward splitting method for maximal monotone mappings[J]. SIAM Journal on Control and Optimization, 2000, 38(2): 431-446.
[5] BERGER J O. Statistical decision theory and Bayesian analysis[M]. New York: Springer, 1985.
[6] HARKER P T, PANG Jongshi. Finite dimensional variational inequality and nonlinear complementarity problem: a survey of theory, algorithms, and applications[J]. Math Program: Series B, 1990, 48:161-220.
[7] HOPFIELD J J, TANK D W. Computing with neural circuits: a model[J]. Science, 1986, 233(4764):625-633.
[8] TANK D W, HOPFIELD J J. Simple neural optimization networks: an A/D converter, signal decision circuit, and a linear programming circuit[J]. IEEE Transactions on Circuits and Systems, 1986, 33(5):533-541.
[9] 夏又生, 叶大振. 解L1-范数极小化问题的神经网络[J]. 电子学报, 1997, 25(11):99-102. XIA Yousheng, YE Dazhen. Neural network for solving L1-norm minimization problem[J]. Acta Electronica Sinica, 1997, 25(11):99-102.
[10] XIA Yousheng, WANG Jun. Neural networks for solving least absolute and related problems[J]. Neurocomputing, 1998, 19:13-21.
[11] WANG Zhishun, CHEUNG J, XIA Yousheng, et al. Minimum fuel neural networks and their applications to overcomplete signal representations[J]. IEEE Transactions on Fundamental Theory and Applications, 2000, 47(8):1146-1159.
[12] WANG Zhishun, HE Zhenya, CHEN Jiande. Robust time delay estimation of bioelectric signals[J]. IEEE Transactions on Bio-medical Engineering, 2005, 52(3):454-462.
[13] WANG Zhishun, PETERSON B S. Constrained least absolute deviation neural networks[J]. IEEE Transactions on Neural Networks, 2008, 19(2):273-283.
[14] XIA Yousheng, KAMEL M. Cooperative recurrent neural networks for the constrained L1 estimator[J]. IEEE Transactions on Signal Processing, 2007, 55(7):3192-3206.
[15] XIA Yousheng, KAMEL M. A generalized least absolute deviation method for parameter estimation of autoregressive signals[J]. IEEE Transactions on Neural Networks, 2008, 19(1):107-118.
[16] LIU Qingshan, WANG Jun. L1-Minimization algorithms for sparse signal reconstruction based on a projection neural network[J]. IEEE Transactions on Neural Networks, 2016, 27(6):89-707.
[17] XIA Yousheng, SUN Changyin, ZHENG Weixing. Discrete-time neural network for fast solving large linear L1 estimation problems and its application to image restoration[J]. IEEE Transactions on Neural Networks, 2012, 23(5):812-820.
[18] LI Cuiping, GAO Xingbao, LI Yawei, et al. A new neural network for l1-norm programing[J]. Neurocomputing, 2016, 202:98-103.
[19] XIA Yousheng. A compact cooperative recurrent neural network for computing general constrained l1 norm estimators[J]. IEEE Transactions on Signal Processing, 2009, 57(9):3693-3697.
[20] GAO Xingbao. A novel neural network for nonlinear convex programming[J]. IEEE Transactions on Neural Networks, 2004, 15(3):613-621.
[21] LIU Qingshan, WANG Jun. A projection neural network for constrained quadratic minimax optimization[J]. IEEE Transactions on Neural Networks, 2015, 26:2891-2900.
[22] XUE Xiaoping, BIAN Wei. A project neural network for solving degenerate quadratic minimax problem with linear constraints[J]. Neurocomputing, 2009, 72:1826-1838.
[23] HU Xiaolin. Applications of the general projection neural network in solving extended linear-quadratic programming problems with linear constraints[J]. Neurocomputing, 2009, 72:1131-1137.
[24] QIN Sitian, LE Xinyi, WANG Jun. A neurodynamic optimization approach to bilevel quadratic programming[J]. IEEE Transactions on Neural Networks, 2017, 28(11):2580-2591.
[25] LE Xinyi, WANG Jun. A two-time-scale neurodynamic approach to constrained minimax optimization[J]. IEEE Transactions on Neural Networks, 2017, 28(3):620-629.
[26] GAO Xingbao, LI Cuiping. A new neural network for convex quadratic minimax problems with box and equality constraints[J]. Computers and Chemical Engineering, 2017, 104:1-10.
[27] GAO Xingbao. A neural network for a class of extended linear variational inequalities[J]. Chinese Journal of Electronics, 2001, 10(4):471-475.
[28] GAO Xingbao, LIAO Lizhi. A neural network for monotone variational inequalities with linear constraints[J]. Physics Letters. A, 2003, 307(2):118-128.
[29] DU Lili, GAO Xingbao. A neural network with finite-time convergence for a class of variational inequalities[C] // International Conference on Intelligent Computing. New York: Springer, 2006, 4113:32-41.
[30] GAO Xingbao, LIAO Lizhi. A new projection-based neural network for constrained variational inequalities[J]. IEEE Transactions on Neural Networks, 2009, 15(4):622-628.
[31] GAO Xingbao, LIAO Lizhi. A novel neural network for generally constrained variational inequalities[J]. Computers and Chemical Engineering, 2017, 104:1-10.
[32] GAO Xingbao, LIAO Lizhi. A novel neural network for a class of convex quadratic minimax problems[J]. Neural Computation, 2006, 18(8):1818-1846.
[33] HU Xiaolin, SUN Changyin, ZHANG Bo. Design of recurrent neural networks for solving constrained least absolute deviation problems[J]. IEEE Transactions on Neural Networks, 2010, 21(7):1073-1086.
[34] RUSZCZYNSHI A. Nonlinear optimization[M]. New Jersey: Princrton University Press, 2006
[35] ZABCZYK J. Mathematical control theory: an introduction[M]. New York: Academic Press, 1992.
[36] GAO Xingbao, LIAO Lizhi. A new one-layer network for linear and quadratic programming[J]. IEEE Transactions on Neural Networks, 2010, 21(6):918-929.
[1] 王坤,张瑞霞. 带有病毒携带猪和环境病毒的非洲猪瘟传染病模型的稳定性分析与最优控制[J]. 《山东大学学报(理学版)》, 2026, 61(2): 64-74.
[2] 唐瑜,袁利军Symbol`@@. 微分方程特征值问题的物理信息神经网络数值解法[J]. 《山东大学学报(理学版)》, 2026, 61(2): 26-36.
[3] 陈子杰, 赵东霞, 王一言. 具有3个时滞的递归神经网络系统的稳定性分析[J]. 《山东大学学报(理学版)》, 2026, 61(2): 43-49.
[4] 余雷,孙懿,华金铭,李腊全. 基于深度神经网络的重症监护室脓毒症患者死亡风险预测模型分析[J]. 《山东大学学报(理学版)》, 2026, 61(1): 26-35.
[5] 吴辛尧,徐计. 基于图互信息池化的分层图表示学习[J]. 《山东大学学报(理学版)》, 2025, 60(7): 84-93.
[6] 买阿丽,孙国伟. 捕食者斑块间扩散的集合种群模型的稳定性分析[J]. 《山东大学学报(理学版)》, 2025, 60(4): 20-28.
[7] 李丝雨,杨赟瑞. 一类非对称非局部扩散系统双稳行波解的稳定性[J]. 《山东大学学报(理学版)》, 2025, 60(4): 40-49.
[8] 秦佳欣, 李淑萍. 复杂网络中带有自我防护意识的SEIR模型分析[J]. 《山东大学学报(理学版)》, 2025, 60(4): 60-71.
[9] 李璐,张瑞霞. 一类具有双垂直传播和媒介呈Logistic增长的媒介传染病模型[J]. 《山东大学学报(理学版)》, 2025, 60(4): 93-103.
[10] 闫晟煜,刘杨,刘继祥,陈海峰,郑元旺,温福华,王洪瑀. 基于GA-BP神经网络模型的二手载货汽车价值评估方法[J]. 《山东大学学报(理学版)》, 2025, 60(12): 11-20.
[11] 蒋晓倩,孙秀萍,宋爱新. 表面活性剂和纳米颗粒稳定的双重乳液凝胶[J]. 《山东大学学报(理学版)》, 2025, 60(10): 141-149.
[12] 杜文慧,熊向团. 时间分数阶扩散方程同时反演源项和初值的迭代分数次[J]. 《山东大学学报(理学版)》, 2024, 59(8): 77-83.
[13] 黄兴宇,赵明宇,吕子钰. 面向图神经网络表征学习的类别知识探针[J]. 《山东大学学报(理学版)》, 2024, 59(7): 85-94.
[14] 罗奇,苟刚. 基于聚类和群组归一化的多模态对话情绪识别[J]. 《山东大学学报(理学版)》, 2024, 59(7): 105-112.
[15] 黎超,廖薇. 基于医疗知识驱动的中文疾病文本分类模型[J]. 《山东大学学报(理学版)》, 2024, 59(7): 122-130.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!