Shwai He

According to our database, Shwai He authored at least 23 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Router-Tuning: A Simple and Effective Approach for Enabling Dynamic-Depth in Transformers.

Shwai He, Tao Ge, Guoheng Sun, Bowei Tian, Xiaoyang Wang, Ang Li, Dong Yu

CoRR, 2024

What Matters in Transformers? Not All Attention is Needed.

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

CoRR, 2024

Loki: Low-Rank Keys for Efficient Sparse Attention.

Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, Abhinav Bhatele

CoRR, 2024

Demystifying the Compression of Mixture-of-Experts Through a Unified Framework.

Shwai He, Daize Dong, Liang Ding, Ang Li

CoRR, 2024

RESSA: Repair Sparse Vision-Language Models via Sparse Cross-Modality Adaptation.

Shwai He, Tianlong Chen

CoRR, 2024

Reformatted Alignment.

Run-Ze Fan, Xuefeng Li, Haoyang Zou, Junlong Li, Shwai He, Ethan Chern, Jiewen Hu, Pengfei Liu

CoRR, 2024

Accurate prediction of antibody function and structure using bio-inspired antibody language model.

Hongtai Jing, Zhengtao Gao, Sheng Xu, Tao Shen, Zhangzhi Peng, Shwai He, Tao You, Shuang Ye, Wei Lin, Siqi Sun

Briefings Bioinform., 2024

Reformatted Alignment.

Run-Ze Fan, Xuefeng Li, Haoyang Zou, Junlong Li, Shwai He, Ethan Chern, Jiewen Hu, Pengfei Liu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning.

Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao, Jianzong Wang, Ning Cheng, Tianyi Zhou

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning.

Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning.

Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Heng Huang, Jiuxiang Gu, Tianyi Zhou

CoRR, 2023

MerA: Merging Pretrained Adapters For Few-Shot Learning.

Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao

CoRR, 2023

SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution.

Shwai He, Chenbo Jiang, Daize Dong, Liang Ding

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

NeuralSlice: Neural 3D Triangle Mesh Reconstruction via Slicing 4D Tetrahedral Meshes.

Chenbo Jiang, Jie Yang, Shwai He, Yu-Kun Lai, Lin Gao

Proceedings of the International Conference on Machine Learning, 2023

Merging Experts into One: Improving Computational Efficiency of Mixture of Experts.

Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

PAD-Net: An Efficient Framework for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Cherry Hypothesis: Identifying the Cherry on the Cake for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

CoRR, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Miao Zhang, Dacheng Tao

CoRR, 2022

Vega-MT: The JD Explore Academy Translation System for WMT22.

Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao

CoRR, 2022

When Sparsity Meets Dynamic Convolution.

Shwai He, Yuhang Li, Chenbo Jiang, Shi Gu

CoRR, 2022

Vega-MT: The JD Explore Academy Machine Translation System for WMT22.

Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao

Proceedings of the Seventh Conference on Machine Translation, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Jeremy Zhang, Dacheng Tao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

Multi-modal Attention Network for Stock Movements Prediction.

Shwai He, Shi Gu

CoRR, 2021