Dong Li

According to our database, Dong Li authored at least 13 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet.

Zhen Qin, Yuxin Mao, Xuyang Shen, Dong Li, Jing Zhang, Yuchao Dai, Yiran Zhong

CoRR, 2024

Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective.

Zhen Qin, Xuyang Shen, Dong Li, Weigao Sun, Stan Birchfield, Richard I. Hartley, Yiran Zhong

CoRR, 2024

HGRN2: Gated Linear RNNs with State Expansion.

Zhen Qin, Songlin Yang, Weixuan Sun, Xuyang Shen, Dong Li, Weigao Sun, Yiran Zhong

CoRR, 2024

Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

CoRR, 2024

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

CoRR, 2024

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

Proceedings of the Forty-first International Conference on Machine Learning, 2024

CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Scaling Laws for Linear Complexity Language Models.

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Scaling TransNormer to 175 Billion Parameters.

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Fei Yuan, Xiao Luo, Yu Qiao, Yiran Zhong

CoRR, 2023

Toeplitz Neural Network for Sequence Modeling.

Zhen Qin, Xiaodong Han, Weixuan Sun, Bowen He, Dong Li, Dongxu Li, Yuchao Dai, Lingpeng Kong, Yiran Zhong

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Fine-grained Audible Video Description.

Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

2022

Linear Video Transformer with Feature Fixation.

Kaiyue Lu, Zexiang Liu, Jianyuan Wang, Weixuan Sun, Zhen Qin, Dong Li, Xuyang Shen, Hui Deng, Xiaodong Han, Yuchao Dai, Yiran Zhong

CoRR, 2022

Neural Architecture Search on Efficient Transformers and Beyond.

Zexiang Liu, Dong Li, Kaiyue Lu, Zhen Qin, Weixuan Sun, Jiacheng Xu, Yiran Zhong

CoRR, 2022