Siddhant Ray

According to our database, Siddhant Ray authored at least 6 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing.

Siddhant Ray, Xi Jiang, Jack Luo, Nick Feamster, Junchen Jiang

CoRR, 2024

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion.

Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang

CoRR, 2024

Chatterbox: Robust Transport for LLM Token Streaming under Unstable Network.

Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang

CoRR, 2024

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving.

Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang

Proceedings of the ACM SIGCOMM 2024 Conference, 2024

Eloquent: A More Robust Transmission Scheme for LLM Token Streaming.

Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang

Proceedings of the 2024 SIGCOMM Workshop on Networks for AI Computing, 2024

2022

A new hope for network model generalization.

Alexander Dietmüller, Siddhant Ray, Romain Jacob, Laurent Vanbever

Proceedings of the 21st ACM Workshop on Hot Topics in Networks, 2022