Pinxue Zhao

According to our database, Pinxue Zhao authored at least 3 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

HMoE: Heterogeneous Mixture of Experts for Language Modeling.

An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng Li, Jiaqi Zhu, Zhen Yang, Pinxue Zhao, J. N. Han, Zhanhui Kang, Di Wang, Naoaki Okazaki, Cheng-Zhong Xu

CoRR, 2024

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs.

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

CoRR, 2024

2022

HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System.

Xiaonan Nie, Pinxue Zhao, Xupeng Miao, Tong Zhao, Bin Cui

CoRR, 2022