Wencong Xiao

According to our database, Wencong Xiao authored at least 31 papers between 2015 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2024

Multi-residual unit fusion and Wasserstein distance-based deep transfer learning for mill load recognition.

Huazhi Xu, Xiaoyan Luo, Wencong Xiao

Signal Image Video Process., June, 2024

ElasticBatch: A Learning-Augmented Elastic Scheduling System for Batch Inference on MIG.

Jiaxing Qi, Wencong Xiao, Mingzhen Li, Chaojie Yang, Yong Li, Wei Lin, Hailong Yang, Zhongzhi Luan, Depei Qian

IEEE Trans. Parallel Distributed Syst., 2024

Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling.

Xinyi Zhang, Hanyu Zhao, Wencong Xiao, Xianyan Jia, Fei Xu, Yong Li, Wei Lin, Fangming Liu

CoRR, 2024

Boosting Large-scale Parallel Training Efficiency with C4: A Communication-Driven Approach.

Jianbo Dong, Bin Luo, Jun Zhang, Pengcheng Zhang, Fei Feng, Yikai Zhu, Ang Liu, Zian Chen, Yi Shi, Hairong Jiao, Gang Lu, Yu Guan, Ennan Zhai, Wencong Xiao, Hanyu Zhao, Man Yuan, Siran Yang, Xiang Li, Jiamang Wang, Rui Men, Jianwei Zhang, Huang Zhong, Dennis Cai, Yuan Xie, Binzhang Fu

CoRR, 2024

Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache.

Bin Lin, Tao Peng, Chen Zhang, Minmin Sun, Lanbo Li, Hanyu Zhao, Wencong Xiao, Qi Xu, Xiafei Qiu, Shen Li, Zhigang Ji, Yong Li, Wei Lin

CoRR, 2024

Crux: GPU-Efficient Communication Scheduling for Deep Learning Training.

Jiamin Cao, Yu Guan, Kun Qian, Jiaqi Gao, Wencong Xiao, Jianbo Dong, Binzhang Fu, Dennis Cai, Ennan Zhai

Proceedings of the ACM SIGCOMM 2024 Conference, 2024

Llumnix: Dynamic Scheduling for Large Language Model Serving.

Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

2023

GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning.

Hanyu Zhao, Zhi Yang, Yu Cheng, Chao Tian, Shiru Ren, Wencong Xiao, Man Yuan, Langshi Chen, Kaibo Liu, Yang Zhang, Yong Li, Wei Lin

Proc. ACM Manag. Data, 2023

FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving.

Tengju Ye, Wei Jing, Chunyong Hu, Shikun Huang, Lingping Gao, Fangzhen Li, Jingke Wang, Ke Guo, Wencong Xiao, Weibo Mao, Hang Zheng, Kun Li, Junbo Chen, Kaicheng Yu

CoRR, 2023

MIGPerf: A Comprehensive Benchmark for Deep Learning Training and Inference Workloads on Multi-Instance GPUs.

Huaizheng Zhang, Yuanming Li, Wencong Xiao, Yizheng Huang, Xing Di, Jianxiong Yin, Simon See, Yong Luo, Chiew Tong Lau, Yang You

CoRR, 2023

EasyScale: Elastic Training with Consistent Accuracy and Improved Utilization on GPUs.

Mingzhen Li, Wencong Xiao, Hailong Yang, Biao Sun, Hanyu Zhao, Shiru Ren, Zhongzhi Luan, Xianyan Jia, Yi Liu, Yong Li, Wei Lin, Depei Qian

Proceedings of the International Conference for High Performance Computing, 2023

2022

EasyScale: Accuracy-consistent Elastic Training for Deep Learning.

Mingzhen Li, Wencong Xiao, Biao Sun, Hanyu Zhao, Hailong Yang, Shiru Ren, Zhongzhi Luan, Xianyan Jia, Yi Liu, Yong Li, Depei Qian, Wei Lin

CoRR, 2022

Whale: Efficient Giant Model Training over Heterogeneous GPUs.

Xianyan Jia, Le Jiang, Ang Wang, Wencong Xiao, Ziji Shi, Jie Zhang, Xinyuan Li, Langshi Chen, Yong Li, Zhen Zheng, Xiaoyong Liu, Wei Lin

Proceedings of the 2022 USENIX Annual Technical Conference, 2022

CoGNN: Efficient Scheduling for Concurrent GNN Training on GPUs.

Qingxiao Sun, Yi Liu, Hailong Yang, Ruizhe Zhang, Ming Dun, Mingzhen Li, Xiaoyan Liu, Wencong Xiao, Yong Li, Zhongzhi Luan, Depei Qian

Proceedings of the SC22: International Conference for High Performance Computing, 2022

MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters.

Qizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang, Cheng Wang, Jian He, Yong Li, Liping Zhang, Wei Lin, Yu Ding

Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, 2022

2021

Zico: Efficient GPU Memory Sharing for Concurrent DNN Training.

Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon

Proceedings of the 2021 USENIX Annual Technical Conference, 2021

2020

Distributed Graph Computation Meets Machine Learning.

Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou

IEEE Trans. Parallel Distributed Syst., 2020

Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training.

Chen Xing, Wencong Xiao, Yong Li, Wei Lin

CoRR, 2020

AntMan: Dynamic Scaling on GPU Clusters for Deep Learning.

Wencong Xiao, Shiru Ren, Yong Li, Yang Zhang, Pengyang Hou, Zhi Li, Yihui Feng, Wei Lin, Yangqing Jia

Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation, 2020

An empirical study on program failures of deep learning jobs.

Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang

Proceedings of the ICSE '20: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June, 2020

2019

BeamRaster: A Practical Fast Massive MU-MIMO System With Pre-Computed Precoders.

Meng Meng, Wencong Xiao, Tong He, Yuechen Tao, Kun Tan, Jiansong Zhang, Wenjie Wang

IEEE Trans. Mob. Comput., 2019

Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads.

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

Proceedings of the 2019 USENIX Annual Technical Conference, 2019

Efficient and Effective Sparse LSTM on FPGA with Bank-Balanced Sparsity.

Shijie Cao, Chen Zhang, Zhuliang Yao, Wencong Xiao, Lanshun Nie, De-chen Zhan, Yunxin Liu, Ming Wu, Lintao Zhang

Proceedings of the 2019 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, 2019

SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization.

Shijie Cao, Lingxiao Ma, Wencong Xiao, Chen Zhang, Yunxin Liu, Lintao Zhang, Lanshun Nie, Zhi Yang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Balanced Sparsity for Efficient DNN Inference on GPU.

Zhuliang Yao, Shijie Cao, Wencong Xiao, Chen Zhang, Lanshun Nie

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Gandiva: Introspective Cluster Scheduling for Deep Learning.

Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou

Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation, 2018

Scheduling CPU for GPU-based Deep Learning Jobs.

Wencong Xiao, Zhenhua Han, Hanyu Zhao, Xuan Peng, Quanlu Zhang, Fan Yang, Lidong Zhou

Proceedings of the ACM Symposium on Cloud Computing, 2018

2017

KV-Direct: High-Performance In-Memory Key-Value Store with Programmable NIC.

Bojie Li, Zhenyuan Ruan, Wencong Xiao, Yuanwei Lu, Yongqiang Xiong, Andrew Putnam, Enhong Chen, Lintao Zhang

Proceedings of the 26th Symposium on Operating Systems Principles, 2017

Tux²: Distributed Graph Computation for Machine Learning.

Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou

Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation, 2017

Memory Efficient Loss Recovery for Hardware-based Transport in Datacenter.

Yuanwei Lu, Guo Chen, Zhenyuan Ruan, Wencong Xiao, Bojie Li, Jiansong Zhang, Yongqiang Xiong, Peng Cheng, Enhong Chen

Proceedings of the First Asia-Pacific Workshop on Networking, 2017

2015

GraM: scaling graph computation to the trillions.

Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou

Proceedings of the Sixth ACM Symposium on Cloud Computing, 2015