Xingtai Lv

According to our database, Xingtai Lv authored at least 11 papers between 2023 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization.

Ermo Hua, Che Jiang, Xingtai Lv, Kaiyan Zhang, Ning Ding, Youbang Sun, Biqing Qi, Yuchen Fan, Xuekai Zhu, Bowen Zhou

CoRR, 2024

How to Synthesize Text Data without Model Collapse?

Xuekai Zhu, Daixuan Cheng, Hengli Li, Kaiyan Zhang, Ermo Hua, Xingtai Lv, Ning Ding, Zhouhan Lin, Zilong Zheng, Bowen Zhou

CoRR, 2024

Automating Exploratory Proteomics Research via Language Models.

Ning Ding, Shang Qu, Linhai Xie, Yifei Li, Zaoqu Liu, Kaiyan Zhang, Yibai Xiong, Yuxin Zuo, Zhangren Chen, Ermo Hua, Xingtai Lv, Youbang Sun, Yang Li, Dong Li, Fuchu He, Bowen Zhou

CoRR, 2024

Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

Kaiyan Zhang, Jianyu Wang, Ning Ding, Biqing Qi, Ermo Hua, Xingtai Lv, Bowen Zhou

CoRR, 2024

UltraMedical: Building Specialized Generalists in Biomedicine.

Kaiyan Zhang, Sihang Zeng, Ermo Hua, Ning Ding, Zhang-Ren Chen, Zhiyuan Ma, Haoxin Li, Ganqu Cui, Biqing Qi, Xuekai Zhu, Xingtai Lv, Jinfang Hu, Zhiyuan Liu, Bowen Zhou

CoRR, 2024

Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process.

Ermo Hua, Biqing Qi, Kaiyan Zhang, Yue Yu, Ning Ding, Xingtai Lv, Kai Tian, Bowen Zhou

CoRR, 2024

Mastering Text, Code and Math Simultaneously via Fusing Highly Specialized Language Models.

Ning Ding, Yulin Chen, Ganqu Cui, Xingtai Lv, Weilin Zhao, Ruobing Xie, Bowen Zhou, Zhiyuan Liu, Maosong Sun

CoRR, 2024

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention.

Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Sparse Low-rank Adaptation of Pre-trained Language Models.

Ning Ding, Xingtai Lv, Qiaosen Wang, Yulin Chen, Bowen Zhou, Zhiyuan Liu, Maosong Sun

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Parameter-efficient Weight Ensembling Facilitates Task-level Knowledge Transfer.

Xingtai Lv, Ning Ding, Yujia Qin, Zhiyuan Liu, Maosong Sun

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models.

Shengding Hu, Ning Ding, Weilin Zhao, Xingtai Lv, Zhen Zhang, Zhiyuan Liu, Maosong Sun

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2023