Junbo Deng

According to our database, Junbo Deng authored at least 2 papers in 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

AttentionStore: Cost-effective Attention Reuse across Multi-turn Conversations in Large Language Model Serving.

Bin Gao, Zhuomin He, Puru Sharma, Qingxuan Kang, Djordje Jevdjic, Junbo Deng, Xingkun Yang, Zhou Yu, Pengfei Zuo

CoRR, 2024

Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention.

Bin Gao, Zhuomin He, Puru Sharma, Qingxuan Kang, Djordje Jevdjic, Junbo Deng, Xingkun Yang, Zhou Yu, Pengfei Zuo

Proceedings of the 2024 USENIX Annual Technical Conference, 2024