Jiangfei Duan

According to our database, Jiangfei Duan authored at least 9 papers in 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Proteus: Simulating the Performance of Distributed DNN Training.

Jiangfei Duan, Xiuhong Li, Ping Xu, Xingcheng Zhang, Shengen Yan, Yun Liang, Dahua Lin

IEEE Trans. Parallel Distributed Syst., October, 2024

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey.

Jiangfei Duan, Shuo Zhang, Zerui Wang, Lijuan Jiang, Wenwen Qu, Qinghao Hu, Guoteng Wang, Qizhen Weng, Hang Yan, Xingcheng Zhang, Xipeng Qiu, Dahua Lin, Yonggang Wen, Xin Jin, Tianwei Zhang, Peng Sun

CoRR, 2024

SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention.

Qianchao Zhu, Jiangfei Duan, Chang Chen, Siran Liu, Xiuhong Li, Guanyu Feng, Xin Lv, Huanqi Cao, Xiao Chuanfu, Xingcheng Zhang, Dahua Lin, Chao Yang

CoRR, 2024

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models.

Haojie Duanmu, Zhihang Yuan, Xiuhong Li, Jiangfei Duan, Xingcheng Zhang, Dahua Lin

CoRR, 2024

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving.

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

CoRR, 2024

Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances.

Jiangfei Duan, Ziang Song, Xupeng Miao, Xiaoli Xi, Dahua Lin, Harry Xu, Minjia Zhang, Zhihao Jia

Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation, 2024

MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving.

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

SpotServe: Serving Generative Large Language Models on Preemptible Instances.

Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

Centauri: Enabling Efficient Scheduling for Communication-Computation Overlap in Large Model Training via Communication Partitioning.

Chang Chen, Xiuhong Li, Qianchao Zhu, Jiangfei Duan, Peng Sun, Xingcheng Zhang, Chao Yang

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024