Jiaao He

According to our database, Jiaao He authored at least 11 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous Pipelines.

Jiaao He, Jidong Zhai

CoRR, 2024

POSTER: Pattern-Aware Sparse Communication for Scalable Recommendation Model Training.

Jiaao He, Shengqi Chen, Jidong Zhai

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

2023

SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization.

Mingshu Zhai, Jiaao He, Zixuan Ma, Zan Zong, Runqing Zhang, Jidong Zhai

Proceedings of the 2023 USENIX Annual Technical Conference, 2023

2022

BaGuaLu: targeting brain scale pretrained models with over 37 million cores.

Zixuan Ma, Jiaao He, Jiezhong Qiu, Huanqi Cao, Yuanwei Wang, Zhenbo Sun, Liyan Zheng, Haojie Wang, Shizhi Tang, Tianyu Zheng, Junyang Lin, Guanyu Feng, Zeqiang Huang, Jie Gao, Aohan Zeng, Jianwei Zhang, Runxin Zhong, Tianhui Shi, Sha Liu, Weimin Zheng, Jie Tang, Hongxia Yang, Xin Liu, Jidong Zhai, Wenguang Chen

Proceedings of the PPoPP '22: 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Seoul, Republic of Korea, April 2, 2022

FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models.

Jiaao He, Jidong Zhai, Tiago Antunes, Haojie Wang, Fuwen Luo, Shangfeng Shi, Qin Li

Proceedings of the PPoPP '22: 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Seoul, Republic of Korea, April 2, 2022

Efficiently emulating high-bitwidth computation with low-bitwidth hardware.

Zixuan Ma, Haojie Wang, Guanyu Feng, Chen Zhang, Lei Xie, Jiaao He, Shengqi Chen, Jidong Zhai

Proceedings of the ICS '22: 2022 International Conference on Supercomputing, Virtual Event, June 28, 2022

2021

Critique of "Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility" by SCC Team From Tsinghua University.

Chen Zhang, Chenggang Zhao, Jiaao He, Shengqi Chen, Liyan Zheng, Kezhao Huang, Wentao Han, Jidong Zhai

IEEE Trans. Parallel Distributed Syst., 2021

FastMoE: A Fast Mixture-of-Expert Training System.

Jiaao He, Jiezhong Qiu, Aohan Zeng, Zhilin Yang, Jidong Zhai, Jie Tang

CoRR, 2021

2020

Prague: High-Performance Heterogeneity-Aware Asynchronous Decentralized Training.

Qinyi Luo, Jiaao He, Youwei Zhuo, Xuehai Qian

Proceedings of the ASPLOS '20: Architectural Support for Programming Languages and Operating Systems, 2020

2019

Student Cluster Competition 2018, Team Tsinghua University: Reproducing performance of multi-physics simulations of the Tsunamigenic 2004 Sumatra megathrust earthquake on the Intel Skylake Architecture.

Jiaao He, Chenggang Zhao, Jiping Yu, Xinjian Yu, Liyan Zheng, Chenyao Lou, Shizhi Tang, Wentao Han, Jidong Zhai

Parallel Comput., 2019

Heterogeneity-Aware Asynchronous Decentralized Training.

Qinyi Luo, Jiaao He, Youwei Zhuo, Xuehai Qian

CoRR, 2019