2025
A robust stochastic quasi-Newton algorithm for non-convex machine learning.
Appl. Intell., May, 2025
Convergence of Adam for non-convex objectives: relaxed hyperparameters and non-ergodic case.
Mach. Learn., March, 2025
Cramér-Rao Lower Bounds for Unconstrained and Constrained Quaternion Parameters.
IEEE Trans. Signal Process., 2025
On the Convergence of Decentralized Stochastic Gradient Descent With Biased Gradients.
IEEE Trans. Signal Process., 2025
Optimizing beamforming in quaternion signal processing using projected gradient descent algorithm.
Signal Process., 2025
DMAdam: Dual averaging enhanced adaptive gradient method for deep neural networks.
Knowl. Based Syst., 2025
A neurodynamic approach with fixed-time convergence for complex-variable pseudo-monotone variational inequalities.
Neurocomputing, 2025
An adaptive gradient method with transformation bound.
Neurocomputing, 2025
2024
Convergence Analysis of Online Gradient Method for High-Order Neural Networks and Their Sparse Optimization.
IEEE Trans. Neural Networks Learn. Syst., December, 2024
Almost sure convergence of stochastic composite objective mirror descent for non-convex non-smooth optimization.
Optim. Lett., December, 2024
Cross-Modal Supervised Human Body Pose Recognition Techniques for Through-Wall Radar.
Sensors, April, 2024
ABNGrad: adaptive step size gradient descent for optimizing neural networks.
Appl. Intell., February, 2024
mPage: Probabilistic Gradient Estimator With Momentum for Non-Convex Optimization.
IEEE Trans. Signal Process., 2024
Price's Theorem for Quaternion Variables.
IEEE Signal Process. Lett., 2024
An Iterative Algorithm for Quaternion Eigenvalue Problems in Signal Processing.
IEEE Signal Process. Lett., 2024
A novel predefined-time neurodynamic approach for mixed variational inequality problems and applications.
Neural Networks, 2024
Shuffling-type gradient method with bandwidth-based step sizes for finite-sum optimization.
Neural Networks, 2024
Decentralized stochastic sharpness-aware minimization algorithm.
Neural Networks, 2024
UAdam: Unified Adam-Type Algorithmic Framework for Nonconvex Optimization.
Neural Comput., 2024
Quaternion Recurrent Neural Network with Real-Time Recurrent Learning and Maximum Correntropy Criterion.
Proceedings of the International Joint Conference on Neural Networks, 2024
2023
Convergence analysis for sparse Pi-sigma neural network model with entropy error function.
Int. J. Mach. Learn. Cybern., December, 2023
Performance bounds of complex-valued nonlinear estimators in learning systems.
Neurocomputing, November, 2023
Stochastic momentum methods for non-convex learning without bounded assumptions.
Neural Networks, August, 2023
Batch Gradient Training Method with Smoothing Group L<sub>0</sub> Regularization for Feedfoward Neural Networks.
Neural Process. Lett., April, 2023
Last-iterate convergence analysis of stochastic momentum methods for neural networks.
Neurocomputing, March, 2023
Convex Quaternion Optimization for Signal Processing: Theory and Applications.
IEEE Trans. Signal Process., 2023
Quaternion Extreme Learning Machine Based on Real Augmented Representation.
IEEE Signal Process. Lett., 2023
The HR-Calculus: Enabling Information Processing with Quaternion Algebra.
CoRR, 2023
UAdam: Unified Adam-Type Algorithmic Framework for Non-Convex Stochastic Optimization.
CoRR, 2023
2022
Target Detection Based on Improved Hausdorff Distance Matching Algorithm for Millimeter-Wave Radar and Video Fusion.
Sensors, 2022
Convergence analysis of AdaBound with relaxed bound functions for non-convex optimization.
Neural Networks, 2022
SGD-rα: A real-time α-suffix averaging method for SGD with biased gradient estimates.
Neurocomputing, 2022
2021
Predicting the Antigenic Relationship of Foot-and-Mouth Disease Virus for Vaccine Selection Through a Computational Model.
IEEE ACM Trans. Comput. Biol. Bioinform., 2021
Convergence of the RMSProp deep learning method with penalty for nonconvex optimization.
Neural Networks, 2021
Scaling transition from momentum stochastic gradient descent to plain stochastic gradient descent.
CoRR, 2021
Decreasing scaling transition from adaptive gradient descent to stochastic gradient descent.
CoRR, 2021
2020
Deterministic convergence of complex mini-batch gradient learning algorithm for fully complex-valued neural networks.
Neurocomputing, 2020
2018
The augmented complex-valued extreme learning machine.
Neurocomputing, 2018
2017
Convergence of Quasi-Newton Method for Fully Complex-Valued Neural Networks.
Neural Process. Lett., 2017
Deterministic Convergence of Wirtinger-Gradient Methods for Complex-Valued Neural Networks.
Neural Process. Lett., 2017
2016
Optimization in Quaternion Dynamic Systems: Gradient, Hessian, and Learning Algorithms.
IEEE Trans. Neural Networks Learn. Syst., 2016
2015
The Theory of Quaternion Matrix Derivatives.
IEEE Trans. Signal Process., 2015
Convergence analysis of an augmented algorithm for fully complex-valued neural networks.
Neural Networks, 2015
Relaxed conditions for convergence of batch BPAP for feedforward neural networks.
Neurocomputing, 2015
2014
Boundedness and Convergence of Split-Complex Back-Propagation Algorithm with Momentum and Penalty.
Neural Process. Lett., 2014
Quaternion Gradient and Hessian.
CoRR, 2014
Finite convergence of the learning algorithms for a modified multi-valued neuron.
Proceedings of the 2014 International Joint Conference on Neural Networks, 2014
The HC calculus, quaternion derivatives and caylay-hamilton form of quaternion adaptive filters and learning systems.
Proceedings of the 2014 International Joint Conference on Neural Networks, 2014
A Quaternion Least Mean Phase adaptive estimator.
Proceedings of the IEEE International Conference on Acoustics, 2014
2013
Convergence of Chaos Injection-Based Batch Backpropagation Algorithm For Feedforward Neural Networks.
Proceedings of the Advances in Neural Networks - ISNN 2013, 2013
2012
A new adaptive momentum algorithm for split-complex recurrent neural networks.
Neurocomputing, 2012
Convergence of an online gradient method with inner-product penalty and adaptive momentum.
Neurocomputing, 2012
2011
Convergence of a Batch Gradient Algorithm with Adaptive Momentum for Neural Networks.
Neural Process. Lett., 2011
2010
Convergence of gradient method for a fully recurrent neural network.
Soft Comput., 2010
Convergence Analysis of Three Classes of Split-Complex Gradient Algorithms for Complex-Valued Recurrent Neural Networks.
Neural Comput., 2010
2007
Convergence of Gradient Descent Algorithm for a Recurrent Neuron.
Proceedings of the Advances in Neural Networks, 2007