Shuai Zheng

According to our database, Shuai Zheng authored at least 33 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2024

DISTMM: Accelerating Distributed Multimodal Model Training.

Jun Huang, Zhen Zhang, Shuai Zheng, Feng Qin, Yida Wang

Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation, 2024

Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping.

Chenyu Jiang, Ye Tian, Zhen Jia, Shuai Zheng, Chuan Wu, Yida Wang

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines.

Chenyu Jiang, Zhen Jia, Shuai Zheng, Yida Wang, Chuan Wu

Proceedings of the Nineteenth European Conference on Computer Systems, 2024

Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training.

Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

2023

Decoupled Model Schedule for Deep Learning Training.

Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang

CoRR, 2023

GEMINI: Fast Failure Recovery in Distributed Training with In-Memory Checkpoints.

Zhuang Wang, Zhen Jia, Shuai Zheng, Zhen Zhang, Xinwei Fu, T. S. Eugene Ng, Yida Wang

Proceedings of the 29th Symposium on Operating Systems Principles, 2023

Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition.

Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alexander J. Smola, Xu Sun

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud.

Zhen Zhang, Shuai Zheng, Yida Wang, Justin Chiu, George Karypis, Trishul Chilimbi, Mu Li, Xin Jin

Proc. VLDB Endow., 2022

SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning.

M. Saiful Bari, Aston Zhang, Shuai Zheng, Xingjian Shi, Yi Zhu, Shafiq Joty, Mu Li

CoRR, 2022

SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing.

Chaoyang He, Shuai Zheng, Aston Zhang, George Karypis, Trishul Chilimbi, Mahdi Soltanolkotabi, Salman Avestimehr

CoRR, 2022

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems.

Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudré, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Liz Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gökhan Tür, Prem Natarajan

CoRR, 2022

DCAF-BERT: A Distilled Cachable Adaptable Factorized Model For Improved Ads CTR Prediction.

Aashiq Muhamed, Jaspreet Singh, Shuai Zheng, Iman Keivanloo, Sujan Perera, James Mracek, Yi Xu, Qingjun Cui, Santosh Rajagopalan, Belinda Zeng, Trishul Chilimbi

Proceedings of the Companion of The Web Conference 2022, Virtual Event / Lyon, France, April 25, 2022

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems.

Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudré, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Lizhen Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gökhan Tür, Prem Natarajan

Proceedings of the KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, August 14, 2022

Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition.

Haotao Wang, Aston Zhang, Yi Zhu, Shuai Zheng, Mu Li, Alex J. Smola, Zhangyang Wang

Proceedings of the International Conference on Machine Learning, 2022

Removing Batch Normalization Boosts Adversarial Training.

Haotao Wang, Aston Zhang, Shuai Zheng, Xingjian Shi, Mu Li, Zhangyang Wang

Proceedings of the International Conference on Machine Learning, 2022

2020

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing.

Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng, Yi Zhu

J. Mach. Learn. Res., 2020

Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes.

Shuai Zheng, Haibin Lin, Sheng Zha, Mu Li

CoRR, 2020

CSER: Communication-efficient SGD with Error Reset.

Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

2019

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing.

Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng

CoRR, 2019

Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning.

Shuai Zheng, James T. Kwok

CoRR, 2019

Give Me a Hint! Navigating Image Databases Using Human-in-the-Loop Feedback.

Bryan A. Plummer, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu

Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2019

Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback.

Shuai Zheng, Ziyue Huang, James T. Kwok

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2018

ModaNet: A Large-scale Street Fashion Dataset with Polygon Annotations.

Shuai Zheng, Fan Yang, M. Hadi Kiapour, Robinson Piramuthu

Proceedings of the 2018 ACM Multimedia Conference on Multimedia Conference, 2018

Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data.

Shuai Zheng, James Tin-Yau Kwok

Proceedings of the 35th International Conference on Machine Learning, 2018

Conditional Image-Text Embedding Networks.

Bryan A. Plummer, Paige Kordas, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu, Svetlana Lazebnik

Proceedings of the Computer Vision - ECCV 2018, 2018

2017

Follow the Moving Leader in Deep Learning.

Shuai Zheng, James T. Kwok

Proceedings of the 34th International Conference on Machine Learning, 2017

2016

Fast-and-Light Stochastic ADMM.

Shuai Zheng, James T. Kwok

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Asynchronous Distributed Semi-Stochastic Gradient Optimization.

Ruiliang Zhang, Shuai Zheng, James T. Kwok

Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 2016

Fast Nonsmooth Regularized Risk Minimization with Continuation.

Shuai Zheng, Ruiliang Zhang, James T. Kwok

Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 2016

2015

Fast Distributed Asynchronous SGD with Variance Reduction.

Ruiliang Zhang, Shuai Zheng, James T. Kwok

CoRR, 2015

2014

Accurate Integration of Aerosol Predictions by Smoothing on a Manifold.

Shuai Zheng, James T. Kwok

Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014

2013

Flexible navigation in smartphones and tablets using scalable storyboards.

Shuai Zheng, Luis Herranz, Shuqiang Jiang

Proceedings of the International Conference on Multimedia Retrieval, 2013

2012

Basis Technology at TAC 2012 Entity Linking.

James Clarke, Yuval Merhav, Ghalib Suleiman, Shuai Zheng, David Murgatroyd

Proceedings of the Fifth Text Analysis Conference, 2012