Zhihao Jia

According to our database, Zhihao Jia authored at least 70 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Quarl: A Learning-Based Quantum Circuit Optimizer.

Zikun Li, Jinjun Peng, Yixuan Mei, Sina Lin, Yi Wu, Oded Padon, Zhihao Jia

Proc. ACM Program. Lang., 2024

Drone-NeRF: Efficient NeRF based 3D scene reconstruction for large-scale drone survey.

Zhihao Jia, Bing Wang, Changhao Chen

Image Vis. Comput., 2024

MagicPIG: LSH Sampling for Efficient LLM Generation.

Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, Yang Zhou, Jianyu Zhang, Niklas Nolte, Yuandong Tian, Matthijs Douze, Léon Bottou, Zhihao Jia, Beidi Chen

CoRR, 2024

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention.

Lijie Yang, Zhihao Zhang, Zhuofu Chen, Zikun Li, Zhihao Jia

CoRR, 2024

Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs (Extended Version).

Mingkuan Xu, Shiyi Cao, Xupeng Miao, Umut A. Acar, Zhihao Jia

CoRR, 2024

GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism.

Byungsoo Jeon, Mengdi Wu, Shiyi Cao, Sunghyun Kim, Sunghyun Park, Neeraj Aggarwal, Colin Unger, Daiyaan Arfeen, Peiyuan Liao, Xupeng Miao, Mohammad Alizadeh, Gregory R. Ganger, Tianqi Chen, Zhihao Jia

CoRR, 2024

SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices.

Ruslan Svirschevski, Avner May, Zhuoming Chen, Beidi Chen, Zhihao Jia, Max Ryabinin

CoRR, 2024

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs.

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

CoRR, 2024

A Multi-Level Superoptimizer for Tensor Programs.

Mengdi Wu, Xinhao Cheng, Oded Padon, Zhihao Jia

CoRR, 2024

FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning.

Xupeng Miao, Gabriele Oliaro, Xinhao Cheng, Mengdi Wu, Colin Unger, Zhihao Jia

CoRR, 2024

Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding.

Zhuoming Chen, Avner May, Ruslan Svirschevski, Yuhsun Huang, Max Ryabinin, Zhihao Jia, Beidi Chen

CoRR, 2024

Accelerating Retrieval-Augmented Language Model Serving with Speculation.

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia

CoRR, 2024

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models.

Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Qing Li, Yong Jiang, Zhihao Jia

CoRR, 2024

Demystifying Data Management for Large Language Models.

Xupeng Miao, Zhihao Jia, Bin Cui

Proceedings of the Companion of the 2024 International Conference on Management of Data, 2024

CLLP: Contrastive Learning Framework Based on Latent Preferences for Next POI Recommendation.

Hongli Zhou, Zhihao Jia, Haiyang Zhu, Zhizheng Zhang

Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024

Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs.

Mingkuan Xu, Shiyi Cao, Xupeng Miao, Umut A. Acar, Zhihao Jia

Proceedings of the International Conference for High Performance Computing, 2024

Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances.

Jiangfei Duan, Ziang Song, Xupeng Miao, Xiaoli Xi, Dahua Lin, Harry Xu, Minjia Zhang, Zhihao Jia

Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation, 2024

X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling.

Xupeng Miao, Shenhan Zhu, Fangcheng Fu, Ziyu Guo, Zhi Yang, Yaofeng Tu, Zhihao Jia, Bin Cui

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024

Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation.

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Intracranial Steno-Occlusive Lesion Detection on Magnetic Resonance Angiography Images.

Zhihao Jia, Chuyang Ye, Youyuan Zhao, Jingang Chen, Jiande Ouyang, Xuesheng Ma

Proceedings of the 2024 16th International Conference on Bioinformatics and Biomedical Technology, 2024

SpotServe: Serving Generative Large Language Models on Preemptible Instances.

Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

Optimal Kernel Orchestration for Tensor Programs with Korch.

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai, Zhihao Jia

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models.

Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Qing Li, Yong Jiang, Zhihao Jia

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Optimizing DNNs With Partially Equivalent Transformations and Automated Corrections.

Haojie Wang, Jidong Zhai, Mingyu Gao, Feng Zhang, Tuowei Wang, Zixuan Ma, Shizhi Tang, Liyan Zheng, Wen Wang, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia

IEEE Trans. Computers, December, 2023

Dynamic Correlation Adjacency-Matrix-Based Graph Neural Networks for Traffic Flow Prediction.

Junhua Gu, Zhihao Jia, Taotao Cai, Xiangyu Song, Adnan Mahmood

Sensors, March, 2023

SDPipe: A Semi-Decentralized Framework for Heterogeneity-aware Pipeline-parallel Training.

Xupeng Miao, Yining Shi, Zhi Yang, Bin Cui, Zhihao Jia

Proc. VLDB Endow., 2023

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Hongyi Jin, Tianqi Chen, Zhihao Jia

CoRR, 2023

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Rae Ying Yee Wong, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

CoRR, 2023

Sia: Heterogeneity-aware, goodput-optimized ML-cluster scheduling.

Suhas Jayaram Subramanya, Daiyaan Arfeen, Shouxu Lin, Aurick Qiao, Zhihao Jia, Gregory R. Ganger

Proceedings of the 29th Symposium on Operating Systems Principles, 2023

EINNET: Optimizing Tensor Programs with Derivation-Based Transformations.

Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shuhong Huang, Xupeng Miao, Shizhi Tang, Kezhao Huang, Zhihao Jia

Proceedings of the 17th USENIX Symposium on Operating Systems Design and Implementation, 2023

TopoOpt: Co-optimizing Network Topology and Parallelization Strategy for Distributed Training Jobs.

Weiyang Wang, Moein Khazraee, Zhizhen Zhong, Manya Ghobadi, Zhihao Jia, Dheevatsa Mudigere, Ying Zhang, Anthony Kewitsch

Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation, 2023

Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs.

John Thorpe, Pengzhan Zhao, Jonathan Eyolfson, Yifan Qiao, Zhihao Jia, Minjia Zhang, Ravi Netravali, Guoqing Harry Xu

Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation, 2023

Building Verified Neural Networks for Computer Systems with Ouroboros.

Cheng Tan, Changliu Liu, Zhihao Jia, Tianhao Wei

Proceedings of the Sixth Conference on Machine Learning and Systems, 2023

2022

TOD: GPU-accelerated Outlier Detection via Tensor Operations.

Yue Zhao, George H. Chen, Zhihao Jia

Proc. VLDB Endow., 2022

Quark: A Gradient-Free Quantum Learning Framework for Classification Tasks.

Zhihao Zhang, Zhuoming Chen, Heyang Huang, Zhihao Jia

CoRR, 2022

OLLIE: Derivation-based Tensor Program Optimizer.

Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shizhi Tang, Lei Xie, Kezhao Huang, Zhihao Jia

CoRR, 2022

Benchmarking Node Outlier Detection on Graphs.

Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, Lichao Sun, Jundong Li, George H. Chen, Zhihao Jia, Philip S. Yu

CoRR, 2022

Optimizing Mixture of Experts using Dynamic Recompilations.

Ferdinand Kossmann, Zhihao Jia, Alex Aiken

CoRR, 2022

PyGOD: A Python Library for Graph Outlier Detection.

Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, George H. Chen, Zhihao Jia, Philip S. Yu

CoRR, 2022

Quartz: Superoptimization of Quantum Circuits (Extended Version).

Mingkuan Xu, Zikun Li, Oded Padon, Sina Lin, Jessica Pointing, Auguste Hirth, Henry Ma, Jens Palsberg, Alex Aiken, Umut A. Acar, Zhihao Jia

CoRR, 2022

Quartz: superoptimization of Quantum circuits.

Mingkuan Xu, Zikun Li, Oded Padon, Sina Lin, Jessica Pointing, Auguste Hirth, Henry Ma, Jens Palsberg, Alex Aiken, Umut A. Acar, Zhihao Jia

Proceedings of the PLDI '22: 43rd ACM SIGPLAN International Conference on Programming Language Design and Implementation, San Diego, CA, USA, June 13, 2022

Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization.

Colin Unger, Zhihao Jia, Wei Wu, Sina Lin, Mandeep Baines, Carlos Efrain Quintero Narvaez, Vinay Ramakrishnaiah, Nirmal Prajapati, Patrick S. McCormick, Jamaludin Mohd-Yusof, Xi Luo, Dheevatsa Mudigere, Jongsoo Park, Misha Smelyanskiy, Alex Aiken

Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation, 2022

BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphs.

Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, Lichao Sun, Jundong Li, George H. Chen, Zhihao Jia, Philip S. Yu

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Software-hardware co-design for fast and scalable training of deep learning recommendation models.

Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Zhihao Jia, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie Amy Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Dimitry Melts, Krishna Dhulipala, K. R. Kishore, Tyler Graf, Assaf Eisenman, Kiran Kumar Matam, Adi Gangidi, Guoqiang Jerry Chen, Manoj Krishnan, Avinash Nayak, Krishnakumar Nair, Bharath Muthiah, Mahmoud khorashadi, Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Ajit Mathews, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, Vijay Rao

Proceedings of the ISCA '22: The 49th Annual International Symposium on Computer Architecture, New York, New York, USA, June 18, 2022

GradSign: Model Performance Inference with Theoretical Insights.

Zhihao Zhang, Zhihao Jia

Proceedings of the Tenth International Conference on Learning Representations, 2022

Collage: Seamless Integration of Deep Learning Backends with Automatic Placement.

Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia

Proceedings of the International Conference on Parallel Architectures and Compilation Techniques, 2022

2021

Quanto: Optimizing Quantum Circuits with Automatic Generation of Circuit Identities.

Jessica Pointing, Oded Padon, Zhihao Jia, Henry Ma, Auguste Hirth, Jens Palsberg, Alex Aiken

CoRR, 2021

Collage: Automated Integration of Deep Learning Backends.

Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia

CoRR, 2021

TOD: Tensor-based Outlier Detection.

Yue Zhao, George H. Chen, Zhihao Jia

CoRR, 2021

Scaling implicit parallelism via dynamic control replication.

Michael Bauer, Wonchan Lee, Elliott Slaughter, Zhihao Jia, Mario Di Renzo, Manolis Papadakis, Galen M. Shipman, Patrick S. McCormick, Michael Garland, Alex Aiken

Proceedings of the PPoPP '21: 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2021

PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections.

Haojie Wang, Jidong Zhai, Mingyu Gao, Zixuan Ma, Shizhi Tang, Liyan Zheng, Yuanzhi Li, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia

Proceedings of the 15th USENIX Symposium on Operating Systems Design and Implementation, 2021

Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads.

John Thorpe, Yifan Qiao, Jonathan Eyolfson, Shen Teng, Guanzhou Hu, Zhihao Jia, Jinliang Wei, Keval Vora, Ravi Netravali, Miryung Kim, Guoqing Harry Xu

Proceedings of the 15th USENIX Symposium on Operating Systems Design and Implementation, 2021

IOS: Inter-Operator Scheduler for CNN Acceleration.

Yaoyao Ding, Ligeng Zhu, Zhihao Jia, Gennady Pekhimenko, Song Han

Proceedings of the Fourth Conference on Machine Learning and Systems, 2021

2020

Automated discovery of machine learning optimizations.

Zhihao Jia

PhD thesis, 2020

Improving the Accuracy, Scalability, and Performance of Graph Neural Networks with Roc.

Zhihao Jia, Sina Lin, Mingyu Gao, Matei Zaharia, Alex Aiken

Proceedings of the Third Conference on Machine Learning and Systems, 2020

Redundancy-Free Computation for Graph Neural Networks.

Zhihao Jia, Sina Lin, Rex Ying, Jiaxuan You, Jure Leskovec, Alex Aiken

Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

2019

Redundancy-Free Computation Graphs for Graph Neural Networks.

Zhihao Jia, Sina Lin, Rex Ying, Jiaxuan You, Jure Leskovec, Alex Aiken

CoRR, 2019

TASO: optimizing deep learning computation with automatic generation of graph substitutions.

Zhihao Jia, Oded Padon, James Thomas, Todd Warszawski, Matei Zaharia, Alex Aiken

Proceedings of the 27th ACM Symposium on Operating Systems Principles, 2019

Beyond Data and Model Parallelism for Deep Neural Networks.

Zhihao Jia, Matei Zaharia, Alex Aiken

Proceedings of the Second Conference on Machine Learning and Systems, SysML 2019, 2019

Optimizing DNN Computation with Relaxed Graph Substitutions.

Zhihao Jia, James Thomas, Todd Warszawski, Mingyu Gao, Matei Zaharia, Alex Aiken

Proceedings of the Second Conference on Machine Learning and Systems, SysML 2019, 2019

2018

Research on user behavior clustering algorithm based on mobile application.

Qiubin Su, Zhihao Jia, Lu Lu

J. Intell. Fuzzy Syst., 2018

Isometry: A Path-Based Distributed Data Transfer System.

Zhihao Jia, Sean Treichler, Galen M. Shipman, Patrick S. McCormick, Alex Aiken

Proceedings of the 32nd International Conference on Supercomputing, 2018

Exploring Hidden Dimensions in Parallelizing Convolutional Neural Networks.

Zhihao Jia, Sina Lin, Charles R. Qi, Alex Aiken

Proceedings of the 35th International Conference on Machine Learning, 2018

2017

A Distributed Multi-GPU System for Fast Graph Processing.

Zhihao Jia, Yongkee Kwon, Galen M. Shipman, Patrick S. McCormick, Mattan Erez, Alex Aiken

Proc. VLDB Endow., 2017

Integrating External Resources with a Task-Based Programming Model.

Zhihao Jia, Sean Treichler, Galen M. Shipman, Michael Bauer, Noah Watkins, Carlos Maltzahn, Patrick S. McCormick, Alex Aiken

Proceedings of the 24th IEEE International Conference on High Performance Computing, 2017

2016

SLIK: Scalable Low-Latency Indexes for a Key-Value Store.

Ankita Kejriwal, Arjun Gopalan, Ashish Gupta, Zhihao Jia, Stephen Yang, John K. Ousterhout

Proceedings of the 2016 USENIX Annual Technical Conference, 2016

2015

Automatic and transparent I/O optimization with storage integrated application runtime support.

Noah Watkins, Zhihao Jia, Galen M. Shipman, Carlos Maltzahn, Alex Aiken, Patrick S. McCormick

Proceedings of the 10th Parallel Data Storage Workshop, 2015

2012

Improving Integer Security for Systems with KINT.

Xi Wang, Haogang Chen, Zhihao Jia, Nickolai Zeldovich, M. Frans Kaashoek

Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, 2012

Undefined behavior: what happened to my code?

Xi Wang, Haogang Chen, Alvin Cheung, Zhihao Jia, Nickolai Zeldovich, M. Frans Kaashoek

Proceedings of the Asia-Pacific Workshop on Systems, 2012