Shiyi Cao

According to our database, Shiyi Cao authored at least 19 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference.

Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

CoRR, 2024

Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs (Extended Version).

Mingkuan Xu, Shiyi Cao, Xupeng Miao, Umut A. Acar, Zhihao Jia

CoRR, 2024

GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism.

Byungsoo Jeon, Mengdi Wu, Shiyi Cao, Sunghyun Kim, Sunghyun Park, Neeraj Aggarwal, Colin Unger, Daiyaan Arfeen, Peiyuan Liao, Xupeng Miao, Mohammad Alizadeh, Gregory R. Ganger, Tianqi Chen, Zhihao Jia

CoRR, 2024

Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models.

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, Bin Cui

CoRR, 2024

Optimizing LLM Queries in Relational Workloads.

Shu Liu, Asim Biswal, Audrey Cheng, Xiangxi Mo, Shiyi Cao, Joseph E. Gonzalez, Ion Stoica, Matei Zaharia

CoRR, 2024

Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs.

Mingkuan Xu, Shiyi Cao, Xupeng Miao, Umut A. Acar, Zhihao Jia

Proceedings of the International Conference for High Performance Computing, 2024

Fairness in Serving Large Language Models.

Ying Sheng, Shiyi Cao, Dacheng Li, Banghua Zhu, Zhuohan Li, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

SLoRA: Scalable Serving of Thousands of LoRA Adapters.

Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph Gonzalez, Ion Stoica

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

2023

Understanding Spatial-Temporal Interactions of Ecosystem Services and Their Drivers in a Multi-Scale Perspective of Miluo Using Multi-Source Remote Sensing Data.

Shiyi Cao, Xijun Hu, Yezi Wang, Cunyou Chen, Dong Xu, Tingting Bai

Remote. Sens., July, 2023

Efficiently Programming Large Language Models using SGLang.

Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Jeff Huang, Chuyue Sun, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, Ying Sheng

CoRR, 2023

S-LoRA: Serving Thousands of Concurrent LoRA Adapters.

Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph E. Gonzalez, Ion Stoica

CoRR, 2023

2022

Low-loss Mode Field Adapter Using Reverse Tapering for Fundamental Mode Transmission over MMFs.

Linbo Yang, Zhiqun Yang, Tao Xu, Lijie Hou, Rui Zhou, Lin Gan, Shiyi Cao, Xinhua Xiao, Lin Zhang

Proceedings of the Optical Fiber Communications Conference and Exhibition, 2022

Novel Mirror-flipped Mode Permutation Technique for Long-haul Mode-division Multiplexing Transmissions.

Yanze Wang, Tianyu Gao, Yaping Liu, Tao Xu, Wenbo Yu, Zhiqun Yang, Qiang Guo, Rui Zhou, Shiyi Cao, Xinhua Xiao, Lin Zhang

Proceedings of the Optical Fiber Communications Conference and Exhibition, 2022

LightPro: Lightweight Probabilistic Workload Prediction Framework for Database-as-a-Service.

Xiuqi Huang, Shiyi Cao, Yuanning Gao, Xiaofeng Gao, Guihai Chen

Proceedings of the IEEE International Conference on Web Services, 2022

Accelerating Data Serialization/Deserialization Protocols with In-Network Compute.

Shiyi Cao, Salvatore Di Girolamo, Torsten Hoefler

Proceedings of the IEEE/ACM International Workshop on Exascale MPI, 2022

2019

AdaM: An Adaptive Fine-Grained Scheme for Distributed Metadata Management.

Shiyi Cao, Yuanning Gao, Xiaofeng Gao, Guihai Chen

Proceedings of the 48th International Conference on Parallel Processing, 2019

2014

Demonstration of ultra-compact contentionless-ROADM based on flexible wavelength router.

Liangjia Zong, Han Zhao, Zhiyong Feng, Shiyi Cao

Proceedings of the European Conference on Optical Communication, 2014

2013

A hybrid seasonal prediction model for tuberculosis incidence in China.

Shiyi Cao, Feng Wang, Wilson Tam, Lap Ah Tse, Jean Hee Kim, Junan Liu, Zuxun Lu

BMC Medical Informatics Decis. Mak., 2013

Green and agile petabit optical sub-wavelength switching prototype for the future OTN multi-chassis switch cluster.

Bo Wu, Shaofeng Qiu, Zhiyong Feng, Shiyi Cao, Han Zhao, Junling Xiang, Chiwu Ding, Gordon Ning Liu, Ning Deng, Qianjin Xiong

Proceedings of the 2013 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference (OFC/NFOEC), 2013