Xiuying Wei

According to our database, Xiuying Wei authored at least 10 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

Investigating Low-Rank Training in Transformer Language Models: Efficiency and Scaling Analysis.

Xiuying Wei, Skander Moalla, Razvan Pascanu, Caglar Gulcehre

CoRR, 2024

Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers.

Xiuying Wei, Skander Moalla, Razvan Pascanu, Caglar Gulcehre

CoRR, 2024

QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models.

Jing Liu, Ruihao Gong, Xiuying Wei, Zhiwei Dong, Jianfei Cai, Bohan Zhuang

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes.

Ruihao Gong, Yang Yong, Zining Wang, Jinyang Guo, Xiuying Wei, Yuqing Ma, Xianglong Liu

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

Selective Focus: Investigating Semantics Sensitivity in Post-training Quantization for Lane Detection.

Yunqian Fan, Xiuying Wei, Ruihao Gong, Yuqing Ma, Xiangguo Zhang, Qi Zhang, Xianglong Liu

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling.

Xiuying Wei, Yunchen Zhang, Yuhang Li, Xiangguo Zhang, Ruihao Gong, Jinyang Guo, Xianglong Liu

CoRR, 2023

Lossy and Lossless (L²) Post-training Model Size Compression.

Yumeng Shi, Shihao Bai, Xiuying Wei, Ruihao Gong, Jianlei Yang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Outlier Suppression+: Accurate quantization of large language models by equivalent and effective shifting and scaling.

Xiuying Wei, Yunchen Zhang, Yuhang Li, Xiangguo Zhang, Ruihao Gong, Jinyang Guo, Xianglong Liu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models.

Xiuying Wei, Yunchen Zhang, Xiangguo Zhang, Ruihao Gong, Shanghang Zhang, Qi Zhang, Fengwei Yu, Xianglong Liu

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization.

Xiuying Wei, Ruihao Gong, Yuhang Li, Xianglong Liu, Fengwei Yu

Proceedings of the Tenth International Conference on Learning Representations, 2022