Yu Sun

According to our database, Yu Sun authored at least 31 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging.

Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Hua Wu, Sen Su

CoRR, 2024

NACL: A General and Effective KV Cache Eviction Framework for LLMs at Inference Time.

Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, Hua Wu

CoRR, 2024

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion.

Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun

CoRR, 2024

HFT: Half Fine-Tuning for Large Language Models.

Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Weiran Xu, Yu Sun, Hua Wu

CoRR, 2024

Dual Modalities of Text: Visual and Textual Generative Pre-training.

Yekun Chai, Qingyi Liu, Jingwu Xiao, Shuohuan Wang, Yu Sun, Hua Wu

CoRR, 2024

Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials.

Mingguo He, Zhewei Wei, Shikun Feng, Zhengjie Huang, Weibin Li, Yu Sun, Dianhai Yu

Proceedings of the ACM on Web Conference 2024, 2024

LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion.

Yilong Chen, Junyuan Shang, Zhenyu Zhang, Shiyao Cui, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Pre-trained Language Model-based Retrieval and Ranking for Web Search.

Lixin Zou, Weixue Lu, Yiding Liu, Hengyi Cai, Xiaokai Chu, Dehong Ma, Daiting Shi, Yu Sun, Zhicong Cheng, Simiu Gu, Shuaiqiang Wang, Dawei Yin

ACM Trans. Web, February, 2023

Tool-Augmented Reward Modeling.

Lei Li, Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Ningyu Zhang, Hua Wu

CoRR, 2023

ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models.

Pengfei Zhu, Chao Pang, Shuohuan Wang, Yekun Chai, Yu Sun, Hao Tian, Hua Wu

CoRR, 2023

Label Information Enhanced Fraud Detection against Low Homophily in Graphs.

Yuchen Wang, Jinghui Zhang, Zhengjie Huang, Weibin Li, Shikun Feng, Ziheng Ma, Yu Sun, Dianhai Yu, Fang Dong, Jiahui Jin, Beilun Wang, Junzhou Luo

Proceedings of the ACM Web Conference 2023, 2023

Retrieval-Augmented Domain Adaptation of Language Models.

Benfeng Xu, Chunxu Zhao, Wenbin Jiang, Pengfei Zhu, Songtai Dai, Chao Pang, Zhuo Sun, Shuohuan Wang, Yu Sun

Proceedings of the 8th Workshop on Representation Learning for NLP, 2023

ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages.

Yekun Chai, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection.

Yaqian Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang

CoRR, 2022

ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding.

Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Teng Hu, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

CoRR, 2022

ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding.

Wenjin Wang, Zhengjie Huang, Bin Luo, Qianglong Chen, Qiming Peng, Yinxu Pan, Weichong Yin, Shikun Feng, Yu Sun, Dianhai Yu, Yin Zhang

CoRR, 2022

Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters.

Yang Xiang, Zhihua Wu, Weibao Gong, Siyu Ding, Xianjie Mo, Yuang Liu, Shuohuan Wang, Peng Liu, Yongshuai Hou, Long Li, Bin Wang, Shaohuai Shi, Yaqian Han, Yue Yu, Ge Li, Yu Sun, Yanjun Ma, Dianhai Yu

CoRR, 2022

X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications.

Junyuan Shang, Shuohuan Wang, Yu Sun, Yanjun Yu, Yue Zhou, Li Xiang, Guixiu Yang

Proceedings of the 16th International Workshop on Semantic Evaluation, SemEval@NAACL 2022, 2022

X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection.

Ya Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang

Proceedings of the 16th International Workshop on Semantic Evaluation, SemEval@NAACL 2022, 2022

mmLayout: Multi-grained MultiModal Transformer for Document Understanding.

Wenjin Wang, Zhengjie Huang, Bin Luo, Qianglong Chen, Qiming Peng, Yinxu Pan, Weichong Yin, Shikun Feng, Yu Sun, Dianhai Yu, Yin Zhang

Proceedings of the MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10, 2022

Simple and Effective Relation-based Embedding Propagation for Knowledge Representation Learning.

Huijuan Wang, Siming Dai, Weiyue Su, Hui Zhong, Zeyang Fang, Zhengjie Huang, Shikun Feng, Zeyu Chen, Yu Sun, Dianhai Yu

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding.

Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Yuhui Cao, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation.

Han Zhang, Weichong Yin, Yewei Fang, Lanxin Li, Boqiang Duan, Zhihua Wu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

CoRR, 2021

Graph4Rec: A Universal Toolkit with Graph Neural Networks for Recommender Systems.

Weibin Li, Mingkai He, Zhengjie Huang, Xianming Wang, Shikun Feng, Weiyue Su, Yu Sun

CoRR, 2021

Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classification.

Yunsheng Shi, Zhengjie Huang, Shikun Feng, Hui Zhong, Wenjing Wang, Yu Sun

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021

ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora.

Xuan Ouyang, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

ERNIE-ViL: Knowledge Enhanced Vision-Language Representations through Scene Graphs.

Fei Yu, Jiji Tang, Weichong Yin, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding.

Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

CoRR, 2020

Masked Label Prediction: Unified Massage Passing Model for Semi-Supervised Classification.

Yunsheng Shi, Zhengjie Huang, Wenjin Wang, Hui Zhong, Shikun Feng, Yu Sun

CoRR, 2020

Kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification.

Jiaxiang Liu, Xuyi Chen, Shikun Feng, Shuohuan Wang, Xuan Ouyang, Yu Sun, Zhengjie Huang, Weiyue Su

Proceedings of the Fourteenth Workshop on Semantic Evaluation, 2020

2013

Generalization of Words for Chinese Dependency Parsing.

Xianchao Wu, Jie Zhou, Yu Sun, Zhanyi Liu, Dianhai Yu, Hua Wu, Haifeng Wang

Proceedings of The 13th International Conference on Parsing Technologies, 2013