Zhenpeng Su

According to our database, Zhenpeng Su authored at least 10 papers between 2023 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

CartesianMoE: Boosting Knowledge Sharing among Experts via Cartesian Product Routing in Mixture-of-Experts.

Zhenpeng Su, Xing Wu, Zijia Lin, Yizhe Xiong, Minxuan Lv, Guangyuan Ma, Hui Chen, Songlin Hu, Guiguang Ding

CoRR, 2024

Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval.

Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou, Songlin Hu

CoRR, 2024

MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts.

Zhenpeng Su, Zijia Lin, Xue Bai, Xing Wu, Yizhe Xiong, Haoran Lian, Guangyuan Ma, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

CoRR, 2024

Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal.

Haoran Lian, Yizhe Xiong, Jianwei Niu, Shasha Mo, Zhenpeng Su, Zijia Lin, Peng Liu, Hui Chen, Guiguang Ding

CoRR, 2024

MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models.

Zhenpeng Su, Zijia Lin, Bai Xue, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

2023

InfoEntropy Loss to Mitigate Bias of Learning Difficulties for Generative Language Models.

Zhenpeng Su, Xing Wu, Xue Bai, Zijia Lin, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

CoRR, 2023

HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpus.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

CoRR, 2023

ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

CoRR, 2023

T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing.

Yuntao Li, Zhenpeng Su, Yutian Li, Hanchu Zhang, Sirui Wang, Wei Wu, Yan Zhang

Proceedings of the IEEE International Conference on Acoustics, 2023