Kaiyue Wen

According to our database, Kaiyue Wen authored at least 12 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency.

Kaiyue Wen, Huaqing Zhang, Hongzhou Lin, Jingzhao Zhang

CoRR, 2024

Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective.

Kaiyue Wen, Zhiyuan Li, Jason Wang, David Hall, Percy Liang, Tengyu Ma

CoRR, 2024

RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval.

Kaiyue Wen, Xingyu Dang, Kaifeng Lyu

CoRR, 2024

2023

Practically Solving LPN in High Noise Regimes Faster Using Neural Networks.

Haozhe Jiang, Kaiyue Wen, Yilei Chen

IACR Cryptol. ePrint Arch., 2023

Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars.

Kaiyue Wen, Yuchen Li, Bingbin Liu, Andrej Risteski

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization.

Kaiyue Wen, Zhiyuan Li, Tengyu Ma

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models.

Kaiyue Wen, Jiaye Teng, Jingzhao Zhang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

How Sharpness-Aware Minimization Minimizes Sharpness?

Kaiyue Wen, Tengyu Ma, Zhiyuan Li

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

How Does Sharpness-Aware Minimization Minimize Sharpness?

Kaiyue Wen, Tengyu Ma, Zhiyuan Li

CoRR, 2022

Realistic Deep Learning May Not Fit Benignly.

Kaiyue Wen, Jiaye Teng, Jingzhao Zhang

CoRR, 2022

On Transferability of Prompt Tuning for Natural Language Processing.

Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Finding Skill Neurons in Pre-trained Transformer-based Language Models.

Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, Lei Hou, Zhiyuan Liu, Juanzi Li

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022