A Novel Error-Based Adaptive Feedback Zeroing Neural Network for Solving Time-Varying Quadratic Programming Problems

Daxuan Yan; Junyun Wu; Jinhua Deng; Zhijun Zhang; Jihong Yu; Peter X. Liu

doi:10.3390/math12132090

journal article Open Access Jul 03, 2024

A Novel Error-Based Adaptive Feedback Zeroing Neural Network for Solving Time-Varying Quadratic Programming Problems

Daxuan Yan Junyun Wu Jinhua Deng Zhijun Zhang

Jihong Yu

Peter X. Liu

Mathematics Vol. 12 No. 13 pp. 2090 · MDPI AG

View at Publisher Save 10.3390/math12132090

Abstract

This paper introduces a novel error-based adaptive feedback zeroing neural network (EAF-ZNN) to solve the time-varying quadratic programming (TVQP) problem. Compared to existing variable gain ZNNs, the EAF-ZNN dynamically adjusts the parameter to adaptively accelerate without increasing to very large values over time. Unlike adaptive fuzzy ZNN, which only considers the current convergence error, EAF-ZNN ensures regulation by introducing a feedback regulation mechanism between the current convergence error, the historical cumulative convergence error, the change rate of the convergence error, and the model gain parameter. This regulation mechanism promotes effective neural dynamic evolution, which results in high convergence rate and accuracy. This paper provides a detailed analysis of the convergence of the model, utilizing four distinct activation functions. Furthermore, the effect of changes in the proportional, integral, and derivative factors in the EAF-ZNN model on the rate of convergence is explored. To assess the superiority of EAF-ZNN in solving TVQP problems, a comparative evaluation with three existing ZNN models is performed. Simulation experiments demonstrate that the EAF-ZNN model exhibits a superior convergence rate. Finally, the EAF-ZNN model is compared with the other three models through the redundant robotic arms example, which achieves smaller position error.

Topics

No keywords indexed for this article. Browse by subject →

References

40

[1]

Reid "Economic dispatch using quadratic programming" IEEE Trans. Power App. Syst. (1973) 10.1109/tpas.1973.293582

[2]

Raja "Design of artificial neural network models optimized with sequential quadratic programming to study the dynamics of nonlinear Troesch’s problem arising in plasma physics" Neural Comput. Appl. (2018) 10.1007/s00521-016-2530-2

[3]

Xiao, L., Zhang, Y., Liao, B., Zhang, Z., Ding, L., and Jin, L. (2017). A velocity-level bi-criteria optimization scheme for coordinated path tracking of dual robot manipulators using recurrent neural network. Front. Neurorob., 11. 10.3389/fnbot.2017.00047

[4]

Wang "Primal-dual interior-point algorithm for convex quadratic semi-definite optimization" Nonlinear Anal.-Theory Methods Appl. (2009) 10.1016/j.na.2009.01.241

[5]

Lemke "A method of solution for quadratic programs" Manag. Sci. (1962) 10.1287/mnsc.8.4.442

[6]

Sequential Quadratic Programming

Paul T. Boggs, Jon W. Tolle

Acta Numerica 1995 10.1017/s0962492900002518

[7]

Qin "A two-layer recurrent neural network for nonsmooth convex optimization problems" IEEE Trans. Neural Netw. Learn. Syst. (2014) 10.1109/tnnls.2014.2334364

[8]

Feng "A recurrent neural network with finite-time convergence for convex quadratic bilevel programming problems" Neural Comput. Appl. (2018) 10.1007/s00521-017-2926-7

[9]

Zhang "A power-type varying gain discrete-time recurrent neural network for solving time-varying linear system" Neurocomputing (2020) 10.1016/j.neucom.2020.01.027

[10]

Xiao, J., and Zhou, Z. (2020, January 27–29). Research progress of RNN language model. Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China. 10.1109/icaica50127.2020.9182390

[11]

Lyu, C., Chen, B., Ren, Y., and Ji, D. (2017). Long short-term memory RNN for biomedical named entity recognition. BMC Bioinform., 18. 10.1186/s12859-017-1868-5

[12]

Zhang "Three recurrent neural networks and three numerical methods for solving a repetitive motion planning scheme of redundant robot manipulators" IEEE-ASME Trans. Mechatron. (2017) 10.1109/tmech.2017.2683561

[13]

Nazemi "A gradient-based neural network method for solving strictly convex quadratic programming problems" Cogn. Comput. (2014) 10.1007/s12559-014-9249-0

[14]

Guo "Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving" Neurocomputing (2011) 10.1016/j.neucom.2011.05.021

[15]

Zhang "Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equation" Neural Comput. Appl. (2011) 10.1007/s00521-010-0452-y

[16]

Zhang "Performance analysis of gradient neural network exploited for online time-varying quadratic minimization and equality-constrained quadratic programming" Neurocomputing (2011) 10.1016/j.neucom.2011.02.007

[17]

Zhang "Robustness analysis of the Zhang neural network for online time-varying quadratic optimization" J. Phys. A-Math. Theor. (2010) 10.1088/1751-8113/43/24/245202

[18]

Qi "Finite-time zeroing neural networks with novel activation function and variable parameter for solving time-varying Lyapunov tensor equation" Appl. Math. Comput. (2023)

[19]

Guo "Novel discrete-time Zhang neural network for time-varying matrix inversion" IEEE Trans. Syst. Man Cybern. Syst. (2017) 10.1109/tsmc.2017.2656941

[20]

Zhang "Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse" Inf. Process. Lett. (2015) 10.1016/j.ipl.2015.03.007

[21]

Dai "ZNN with fuzzy adaptive activation functions and its application to time-varying linear matrix equation" IEEE Trans. Ind. Inform. (2021) 10.1109/tii.2021.3099819

[22]

Dai "A fuzzy adaptive zeroing neural network with superior finite-time convergence for solving time-variant linear matrix equations" Knowl.-Based Syst. (2022) 10.1016/j.knosys.2022.108405

[23]

Fu "Recurrent Neural Network with Scheduled Varying Gain for Solving Time-Varying QP" IEEE Trans. Circuits Syst. II-Express Briefs (2024)

[24]

Miao "Solving time-varying quadratic programs based on finite-time Zhang neural networks and their application to robot tracking" Neural Comput. Appl. (2015) 10.1007/s00521-014-1744-4

[25]

Yang "Superior robustness of power-sum activation functions in Zhang neural networks for time-varying quadratic programs perturbed with large implementation errors" Neural Comput. Appl. (2013) 10.1007/s00521-011-0692-5

[26]

A New Varying-Parameter Convergent-Differential Neural-Network for Solving Time-Varying Convex QP Problem Constrained by Linear-Equality

Zhijun Zhang, Yeyun Lu, Shuai Li et al.

IEEE Transactions on Automatic Control 2018 10.1109/tac.2018.2810039

[27]

Xiao "Comprehensive analysis of a new varying parameter zeroing neural network for time varying matrix inversion" IEEE Trans Ind. Inform. (2021) 10.1109/tii.2020.2989173

[28]

Jia "Design and Application of an Adaptive Fuzzy Control Strategy to Zeroing Neural Network for Solving Time-Variant QP Problem" IEEE Trans. Fuzzy Syst. (2021) 10.1109/tfuzz.2020.2981001

[29]

An Adaptive Fuzzy Recurrent Neural Network for Solving the Nonrepetitive Motion Problem of Redundant Robot Manipulators

Zhijun Zhang, Ziyi Yan

IEEE Transactions on Fuzzy Systems 2020 10.1109/tfuzz.2019.2914618

[30]

Li "PID control system analysis and design" IEEE Control Syst. Mag. (2006) 10.1109/mcs.2006.1580152

[31]

Dai "Design and analysis of a self-adaptive zeroing neural network for solving time-varying quadratic programming" IEEE Trans. Neural Netw. Learn. Syst. (2022) 10.1109/tnnls.2021.3138900

[32]

Convex Optimization

Stephen Boyd, Lieven Vandenberghe

10.1017/cbo9780511804441

[33]

Zhang "Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints" Phys. Lett. A (2009) 10.1016/j.physleta.2009.03.011

[34]

Bertsekas, D. (2009). Convex Optimization Theory, Athena Scientific.

[35]

Gratton "On the condition number of linear least squares problems in a weighted Frobenius norm" BIT Numer. Math. (1996) 10.1007/bf01731931

[36]

Jin "Zeroing neural networks: A survey" Neurocomputing (2017) 10.1016/j.neucom.2017.06.030

[37]

Zhang "A varying parameter recurrent neural network for solving nonrepetitive motion problems of redundant robot manipulators" IEEE Trans. Control Syst. Technol. (2018) 10.1109/tcst.2018.2872471

[38]

The general problem of the stability of motion

A. M. LYAPUNOV

International Journal of Control 1992 10.1080/00207179208934253

[39]

Zhang "Design and analysis of a general recurrent neural network model for time-varying matrix inversion" IEEE Trans. Neural Netw. (2005) 10.1109/tnn.2005.857946

[40]

Mudi "A robust self-tuning scheme for PI- and PD-type fuzzy controllers" IEEE Trans. Fuzzy Syst. (1999) 10.1109/91.746295

Cited By

8

Cooperative optimization of zeroing neural networks (ZNN) in dynamic systems: Evolution, advances, and applications

Yixin Liu, Jin Jie · 2026

Neurocomputing

Metrics

8

Citations

40

References

Details

Published: Jul 03, 2024
Vol/Issue: 12(13)
Pages: 2090
License: View

Authors

D

Daxuan Yan

School of Information Engineering, Nanchang University, Nanchang 330031, China

J

Junyun Wu

Jiangxi Provincial Key Laboratory of Intelligent Systems and Human-Machine Interaction, Nanchang 330031, China; School of Mathematics and Computer Sciences, Nanchang University, Nanchang 330031, China

J

Jinhua Deng

School of Information Engineering, Nanchang University, Nanchang 330031, China

Z

Zhijun Zhang

School of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China

J

Jihong Yu

State Key Laboratory for Turbulence and Complex Systems, Department of Mechanics and Engineering Science, BIC-ESAT, College of Engineering, Peking University, Beijing 100871, China

P

Peter X. Liu

Department of Systems and Computer Engineering, Carleton University, Ottawa, ON K1S 5B6, Canada

Funding

National Natural Science Foundation Award: 2024SSY03121

Science and Technology Department of Jiangxi Province of China Award: 2024SSY03121

Jiangxi Provincial Key Laboratory of Intelligent Systems and Human-Machine Interaction Award: 2024SSY03121

Cite This Article

Daxuan Yan, Junyun Wu, Jinhua Deng, et al. (2024). A Novel Error-Based Adaptive Feedback Zeroing Neural Network for Solving Time-Varying Quadratic Programming Problems. Mathematics, 12(13), 2090. https://doi.org/10.3390/math12132090

A Novel Error-Based Adaptive Feedback Zeroing Neural Network for Solving Time-Varying Quadratic Programming Problems

You May Also Like