Haishan Ye

Xiangyu Chang

Eur. J. Oper. Res., 2024

Second-Order Fine-Tuning without Pain for LLMs: A Hessian Informed Zeroth-Order Optimizer.

[BibT_eX]

[DOI]

CoRR, 2024

Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity.

[BibT_eX]

[DOI]

Qihao Zhou

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

Can Gaussian Sketching Converge Faster on a Preconditioned Landscape?

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Double Stochasticity Gazes Faster: Snap-Shot Decentralized Stochastic Gradient Tracking Methods.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold.

[BibT_eX]

[DOI]

Proceedings of the Twelfth International Conference on Learning Representations, 2024

An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization.

[BibT_eX]

[DOI]

Lesi Chen

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2024

2023

Intelligent Image Processing Technology for Badminton Robot under Machine Vision of Internet of Things.

[BibT_eX]

[DOI]

Int. J. Humanoid Robotics, December, 2023

Accelerated Distributed Approximate Newton Method.

[BibT_eX]

[DOI]

Chaoyang He

Xiangyu Chang

IEEE Trans. Neural Networks Learn. Syst., November, 2023

Towards explicit superlinear convergence rate for SR1.

[BibT_eX]

[DOI]

Math. Program., May, 2023

Multi-Consensus Decentralized Accelerated Gradient Descent.

[BibT_eX]

[DOI]

J. Mach. Learn. Res., 2023

PPFL: A Personalized Federated Learning Framework for Heterogeneous Population.

[BibT_eX]

[DOI]

CoRR, 2023

Mirror Natural Evolution Strategies.

[BibT_eX]

[DOI]

CoRR, 2023

Stochastic Distributed Optimization under Average Second-order Similarity: Algorithms and Analysis.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Explicit Convergence Rates of Greedy and Random Quasi-Newton Methods.

[BibT_eX]

[DOI]

Dachao Lin

J. Mach. Learn. Res., 2022

A Simple and Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization.

[BibT_eX]

[DOI]

Lesi Chen

CoRR, 2022

An Optimal Stochastic Algorithm for Decentralized Nonconvex Finite-sum Optimization.

[BibT_eX]

[DOI]

CoRR, 2022

Decentralized Stochastic Variance Reduced Extragradient Method.

[BibT_eX]

[DOI]

CoRR, 2022

Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums.

[BibT_eX]

[DOI]

Rui Pan

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Accelerated Proximal Subsampled Newton Method.

[BibT_eX]

[DOI]

IEEE Trans. Neural Networks Learn. Syst., 2021

DeEPCA: Decentralized Exact PCA with Linear Convergence Rate.

[BibT_eX]

[DOI]

J. Mach. Learn. Res., 2021

Approximate Newton Methods.

[BibT_eX]

[DOI]

J. Mach. Learn. Res., 2021

Greedy and Random Broyden's Methods with Explicit Superlinear Convergence Rates in Nonlinear Equations.

[BibT_eX]

[DOI]

Dachao Lin

CoRR, 2021

Greedy and Random Quasi-Newton Methods with Faster Explicit Superlinear Convergence.

[BibT_eX]

[DOI]

Dachao Lin

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Revisiting Co-Occurring Directions: Sharper Analysis and Efficient Algorithm for Sparse Matrices.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Nesterov's Acceleration for Approximate Newton.

[BibT_eX]

[DOI]

J. Mach. Learn. Res., 2020

PMGT-VR: A decentralized proximal-gradient algorithmic framework with variance reduction.

[BibT_eX]

[DOI]

Wei Xiong

CoRR, 2020

Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problems.

[BibT_eX]

[DOI]

CoRR, 2020

Decentralized Accelerated Proximal Gradient Descent.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problems.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

Fast stochastic second-order method logarithmic in condition number.

[BibT_eX]

[DOI]

Pattern Recognit., 2019

Fast Generalized Matrix Regression with Applications in Machine Learning.

[BibT_eX]

[DOI]

CoRR, 2019

Mirror Natural Evolution Strategies.

[BibT_eX]

[DOI]

CoRR, 2019

2018

Hessian-Aware Zeroth-Order Optimization for Black-Box Adversarial Attack.

[BibT_eX]

[DOI]

CoRR, 2018

2017

Fast Fisher discriminant analysis with randomized algorithms.

[BibT_eX]

[DOI]

Pattern Recognit., 2017

Nesterov's Acceleration For Approximate Newton.

[BibT_eX]

[DOI]

CoRR, 2017

A Unifying Framework for Convergence Analysis of Approximate Newton Methods.

[BibT_eX]

[DOI]

CoRR, 2017

Approximate Newton Methods and Their Local Convergence.

[BibT_eX]

[DOI]

Proceedings of the 34th International Conference on Machine Learning, 2017

2016

Tighter bound of Sketched Generalized Matrix Approximation.

[BibT_eX]

[DOI]

Qiaoming Ye

CoRR, 2016

Revisiting Sub-sampled Newton Methods.

[BibT_eX]

[DOI]

CoRR, 2016

Accelerating Random Kaczmarz Algorithm Based on Clustering Information.

[BibT_eX]

[DOI]

Yujun Li

Kaichun Mo