Xiaoge Deng

According to our database, Xiaoge Deng authored at least 17 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Decentralized stochastic sharpness-aware minimization algorithm.

Simiao Chen, Xiaoge Deng, Dongpo Xu, Tao Sun, Dongsheng Li

Neural Networks, 2024

Federated Prediction-Powered Inference from Decentralized Data.

Ping Luo, Xiaoge Deng, Ziqing Wen, Tao Sun, Dongsheng Li

CoRR, 2024

Score-based Generative Models with Adaptive Momentum.

Ziqing Wen, Xiaoge Deng, Ping Luo, Tao Sun, Dongsheng Li

CoRR, 2024

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients.

Ping Luo, Xiaoge Deng, Ziqing Wen, Tao Sun, Dongsheng Li

CoRR, 2024

Exploring the Inefficiency of Heavy Ball as Momentum Parameter Approaches 1.

Xiaoge Deng, Tao Sun, Dongsheng Li, Xicheng Lu

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024

2023

Compressed Collective Sparse-Sketch for Distributed Data-Parallel Training of Deep Learning Models.

Keshi Ge, Kai Lu, Yongquan Fu, Xiaoge Deng, Zhiquan Lai, Dongsheng Li

IEEE J. Sel. Areas Commun., April, 2023

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent.

Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao

CoRR, 2023

Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training.

Shengwei Li, Zhiquan Lai, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Dongsheng Li, Kai Lu

CoRR, 2023

Normalized Stochastic Heavy Ball with Adaptive Momentum.

Ziqing Wen, Xiaoge Deng, Tao Sun, Dongsheng Li

Proceedings of the ECAI 2023 - 26th European Conference on Artificial Intelligence, September 30 - October 4, 2023, Kraków, Poland, 2023

Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD.

Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning.

Keshi Ge, Yongquan Fu, Yiming Zhang, Zhiquan Lai, Xiaoge Deng, Dongsheng Li

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

SASG: Sparsification with Adaptive Stochastic Gradients for Communication-efficient Distributed Learning.

Xiaoge Deng, Tao Sun, Dongsheng Li

CoRR, 2021

S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning.

Keshi Ge, Yongquan Fu, Zhiquan Lai, Xiaoge Deng, Dongsheng Li

CoRR, 2021

CASQ: Accelerate Distributed Deep Learning with Sketch-Based Gradient Quantization.

Keshi Ge, Yiming Zhang, Yongquan Fu, Zhiquan Lai, Xiaoge Deng, Dongsheng Li

Proceedings of the IEEE International Conference on Cluster Computing, 2021

2020

A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis.

Xiaoge Deng, Tao Sun, Peibing Du, Dongsheng Li

IEEE Access, 2020

Linear Convergence Rate of Splitting Algorithms for Multi-Block Constrained Convex Minimizations.

Xiaoge Deng, Feng Liu, Feng Huang

IEEE Access, 2020

PRIAG: Proximal Reweighted Incremental Aggregated Gradient Algorithm for Distributed Optimizations.

Xiaoge Deng, Tao Sun, Feng Liu, Feng Huang

Proceedings of the Algorithms and Architectures for Parallel Processing, 2020