Shih-Yang Liu

According to our database, Shih-Yang Liu authored at least 10 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation.

Shih-Yang Liu, Huck Yang, Chein-Yi Wang, Nai Chit Fung, Hongxu Yin, Charbel Sakr, Saurav Muralidharan, Kwang-Ting Cheng, Jan Kautz, Yu-Chiang Frank Wang, Pavlo Molchanov, Min-Hung Chen

CoRR, 2024

DoRA: Weight-Decomposed Low-Rank Adaptation.

Shih-Yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen

Proceedings of the Forty-first International Conference on Machine Learning, 2024

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization.

Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers.

Pingcheng Dong, Yonghao Tan, Dong Zhang, Tianwei Ni, Xuejiao Liu, Yu Liu, Peng Luo, Luhong Liang, Shih-Yang Liu, Xijie Huang, Huaiyu Zhu, Yun Pan, Fengwei An, Kwang-Ting Cheng

Proceedings of the 61st ACM/IEEE Design Automation Conference, 2024

CMOSE: Comprehensive Multi-Modality Online Student Engagement Dataset with High-Quality Labels.

Chi-Hsuan Wu, Shih-Yang Liu, Xijie Huang, Xingbo Wang, Rong Zhang, Luca Minciullo, Wong Kai Yiu, Kenny Kwan, Kwang-Ting Cheng

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Efficient Quantization-aware Training with Adaptive Coreset Selection.

Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

CoRR, 2023

Oscillation-free Quantization for Low-bit Vision Transformers.

Shih-Yang Liu, Zechun Liu, Kwang-Ting Cheng

Proceedings of the International Conference on Machine Learning, 2023

LLM-FP4: 4-Bit Floating-Point Quantized Transformers.

Shih-Yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

IPR: Interaction-level Preference Ranking for Explicit feedback.

Shih-Yang Liu, Hsien-Hao Chen, Chih-Ming Chen, Ming-Feng Tsai, Chuan-Ju Wang

Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

Forecasting Asset Dependencies to Reduce Portfolio Risk.

Haoren Zhu, Shih-Yang Liu, Pengfei Zhao, Yingying Chen, Dik Lun Lee

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022