Sukjin Hong

According to our database, Sukjin Hong authored at least 5 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

RILQ: Rank-Insensitive LoRA-based Quantization Error Compensation for Boosting 2-bit Large Language Model Accuracy.

Geonho Lee, Janghwan Lee, Sukjin Hong, Minsoo Kim, Euijai Ahn, Du-Seong Chang, Jungwook Choi

CoRR, 2024

Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment.

Janghwan Lee, Seongmin Park, Sukjin Hong, Minsoo Kim, Du-Seong Chang, Jungwook Choi

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models.

Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective.

Jongwoo Ko, Seungjoon Park, Minchan Jeong, Sukjin Hong, Euijai Ahn, Du-Seong Chang, Se-Young Yun

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

2022

Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders.

Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022