Haojie Duanmu

According to our database, Haojie Duanmu authored at least 4 papers in 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models.

Haojie Duanmu, Zhihang Yuan, Xiuhong Li, Jiangfei Duan, Xingcheng Zhang, Dahua Lin

CoRR, 2024

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving.

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

CoRR, 2024

WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More.

Yuxuan Yue, Zhihang Yuan, Haojie Duanmu, Sifan Zhou, Jianlong Wu, Liqiang Nie

CoRR, 2024

MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving.

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

Proceedings of the Forty-first International Conference on Machine Learning, 2024