Guangxuan Xiao

According to our database, Guangxuan Xiao authored at least 17 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training.

Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang

Proc. VLDB Endow., February, 2024

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads.

Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, Junxian Guo, Shang Yang, Haotian Tang, Yao Fu, Song Han

CoRR, 2024

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving.

Yujun Lin, Haotian Tang, Shang Yang, Zhekai Zhang, Guangxuan Xiao, Chuang Gan, Song Han

CoRR, 2024

Retrieval Head Mechanistically Explains Long-Context Factuality.

Wenhao Wu, Yizhong Wang, Guangxuan Xiao, Hao Peng, Yao Fu

CoRR, 2024

BitDelta: Your Fine-Tune May Only Be Worth One Bit.

James Liu, Guangxuan Xiao, Kai Li, Jason D. Lee, Song Han, Tri Dao, Tianle Cai

CoRR, 2024

InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory.

Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Song Han, Maosong Sun

CoRR, 2024

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration.

Ji Lin, Jiaming Tang, Haotian Tang, Shang Yang, Wei-Ming Chen, Wei-Chen Wang, Guangxuan Xiao, Xingyu Dang, Chuang Gan, Song Han

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference.

Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Efficient Streaming Language Models with Attention Sinks.

Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks.

Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun

Mach. Intell. Res., April, 2023

FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention.

Guangxuan Xiao, Tianwei Yin, William T. Freeman, Frédo Durand, Song Han

CoRR, 2023

Offsite-Tuning: Transfer Learning without Full Model.

Guangxuan Xiao, Ji Lin, Song Han

CoRR, 2023

ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training.

Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang

CoRR, 2023

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models.

Guangxuan Xiao, Ji Lin, Mickaël Seznec, Hao Wu, Julien Demouth, Song Han

Proceedings of the International Conference on Machine Learning, 2023

2022

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models.

Guangxuan Xiao, Ji Lin, Mickaël Seznec, Julien Demouth, Song Han

CoRR, 2022

Sparse and Local Networks for Hypergraph Reasoning.

Guangxuan Xiao, Leslie Pack Kaelbling, Jiajun Wu, Jiayuan Mao

Proceedings of the Learning on Graphs Conference, 2022

2021

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks.

Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun

CoRR, 2021