Daize Dong

According to our database, Daize Dong authored at least 12 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training.

Xiaoye Qu, Daize Dong, Xuyang Hu, Tong Zhu, Weigao Sun, Yu Cheng

CoRR, 2024

DLO: Dynamic Layer Operation for Efficient Vertical Scaling of LLMs.

Zhen Tan, Daize Dong, Xinyu Zhao, Jie Peng, Yu Cheng, Tianlong Chen

CoRR, 2024

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts.

Tong Zhu, Daize Dong, Xiaoye Qu, Jiacheng Ruan, Wenliang Chen, Yu Cheng

CoRR, 2024

Demystifying the Compression of Mixture-of-Experts Through a Unified Framework.

Shwai He, Daize Dong, Liang Ding, Ang Li

CoRR, 2024

A Graph is Worth K Words: Euclideanizing Graph using Pure Transformer.

Zhangyang Gao, Daize Dong, Cheng Tan, Jun Xia, Bozhen Hu, Stan Z. Li

Proceedings of the Forty-first International Conference on Machine Learning, 2024

iDAT: inverse Distillation Adapter-Tuning.

Jiacheng Ruan, Jingsheng Gao, Mingye Xie, Daize Dong, Suncheng Xiang, Ting Liu, Yuzhuo Fu

Proceedings of the IEEE International Conference on Multimedia and Expo, 2024

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training.

Tong Zhu, Xiaoye Qu, Daize Dong, Jiacheng Ruan, Jingqi Tong, Conghui He, Yu Cheng

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution.

Shwai He, Chenbo Jiang, Daize Dong, Liang Ding

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

PAD-Net: An Efficient Framework for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Cherry Hypothesis: Identifying the Cherry on the Cake for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

CoRR, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Miao Zhang, Dacheng Tao

CoRR, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Jeremy Zhang, Dacheng Tao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022