Xuanlei Zhao

According to our database, Xuanlei Zhao authored at least 8 papers in 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Real-Time Video Generation with Pyramid Attention Broadcast.

Xuanlei Zhao, Xiaolong Jin, Kai Wang, Yang You

CoRR, 2024

WallFacer: Guiding Transformer Model Training Out of the Long-Context Dark Forest with N-body Problem.

Ziming Liu, Shaoyu Wang, Shenggan Cheng, Zhongkai Zhao, Xuanlei Zhao, James Demmel, Yang You

CoRR, 2024

DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers.

Xuanlei Zhao, Shenggan Cheng, Zangwei Zheng, Zheming Yang, Ziming Liu, Yang You

CoRR, 2024

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

Xuanlei Zhao, Bin Jia, Haotian Zhou, Ziming Liu, Shenggan Cheng, Yang You

CoRR, 2024

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference.

Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Jiarui Fang, Haotian Zhou, Bin Jia, Ziming Liu, Yang You

CoRR, 2024

FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters.

Shenggan Cheng, Xuanlei Zhao, Guangyang Lu, Jiarui Fang, Tian Zheng, Ruidong Wu, Xiwen Zhang, Jian Peng, Yang You

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

HeteGen: Efficient Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

Xuanlei Zhao, Bin Jia, Haotian Zhou, Ziming Liu, Shenggan Cheng, Yang You

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

AutoChunk: Automated Activation Chunk for Memory-Efficient Deep Learning Inference.

Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Haotian Zhou, Bin Jia, Yang You

Proceedings of the Twelfth International Conference on Learning Representations, 2024