Kan Zhu

According to our database, Kan Zhu authored at least 7 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching.

Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yang Zhou, Jiarong Xing, Ion Stoica

CoRR, 2024

NanoFlow: Towards Optimal Large Language Model Serving Throughput.

Kan Zhu, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Yufei Gao, Qinyu Xu, Tian Tang, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

CoRR, 2024

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Yile Gu, Kan Zhu, Baris Kasikci

CoRR, 2024

Atom: Low-Bit Quantization for Efficient and Accurate LLM Serving.

Yilong Zhao, Chien-Yu Lin, Kan Zhu, Zihao Ye, Lequn Chen, Size Zheng, Luis Ceze, Arvind Krishnamurthy, Tianqi Chen, Baris Kasikci

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference.

Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Can Storage Devices be Power Adaptive?

Dedong Xie, Theano Stavrinos, Kan Zhu, Simon Peter, Baris Kasikci, Thomas E. Anderson

Proceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems, 2024

2016

Practical Algorithms for Learning Near-Isometric Linear Embeddings.

Jerry Luo, Kayla Shapiro, Hao-Jun Michael Shi, Qi Yang, Kan Zhu

CoRR, 2016