Sihwa Lee

According to our database, Sihwa Lee authored at least 4 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models.

Minsoo Kim, Sihwa Lee, Wonyong Sung, Jungwook Choi

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models.

Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders.

Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

NN-LUT: neural approximation of non-linear operations for efficient transformer inference.

Joonsang Yu, Junki Park, Seongmin Park, Minsoo Kim, Sihwa Lee, Dong Hyun Lee, Jungwook Choi

Proceedings of the DAC '22: 59th ACM/IEEE Design Automation Conference, San Francisco, California, USA, July 10, 2022