Nitin Kedia

According to our database, Nitin Kedia authored at least 3 papers in 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Metron: Holistic Performance Evaluation Framework for LLM Inference Systems.

Amey Agrawal, Anmol Agarwal, Nitin Kedia, Jayashree Mohan, Souvik Kundu, Nipun Kwatra, Ramachandran Ramjee, Alexey Tumanov

CoRR, 2024

Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve.

Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav S. Gulavani, Alexey Tumanov, Ramachandran Ramjee

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

VIDUR: A Large-Scale Simulation Framework for LLM Inference.

Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024