Shangchun Zhao

According to our database, Shangchun Zhao authored at least 4 papers between 2023 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism.

Diandian Gu, Peng Sun, Qinghao Hu, Ting Huang, Xun Chen, Yingtong Xiong, Guoteng Wang, Qiaoling Chen, Shangchun Zhao, Jiarui Fang, Yonggang Wen, Tianwei Zhang, Xin Jin, Xuanzhe Liu

CoRR, 2024

USP: A Unified Sequence Parallelism Approach for Long Context Generative AI.

Jiarui Fang, Shangchun Zhao

CoRR, 2024

2023

An Adaptive Placement and Parallelism Framework for Accelerating RLHF Training.

Youshao Xiao, Weichang Wu, Zhenglei Zhou, Fagui Mao, Shangchun Zhao, Lin Ju, Lei Liang, Xiaolu Zhang, Jun Zhou

CoRR, 2023

G-Meta: Distributed Meta Learning in GPU Clusters for Large-Scale Recommender Systems.

Youshao Xiao, Shangchun Zhao, Zhenglei Zhou, Zhaoxin Huan, Lin Ju, Xiaolu Zhang, Lin Wang, Jun Zhou

Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023