Weigao Sun

According to our database, Weigao Sun authored at least 17 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

MS-Net: A Multi-Path Sparse Model for Motion Prediction in Multi-Scenes.

Xiaqiang Tang, Weigao Sun, Siyuan Hu, Yiyang Sun, Yafeng Guo

IEEE Robotics Autom. Lett., January, 2024

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training.

Xiaoye Qu, Daize Dong, Xuyang Hu, Tong Zhu, Weigao Sun, Yu Cheng

CoRR, 2024

Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective.

Zhen Qin, Xuyang Shen, Dong Li, Weigao Sun, Stan Birchfield, Richard I. Hartley, Yiran Zhong

CoRR, 2024

HGRN2: Gated Linear RNNs with State Expansion.

Zhen Qin, Songlin Yang, Weixuan Sun, Xuyang Shen, Dong Li, Weigao Sun, Yiran Zhong

CoRR, 2024

Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

CoRR, 2024

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

CoRR, 2024

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

Proceedings of the Forty-first International Conference on Machine Learning, 2024

CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Scaling Laws for Linear Complexity Language Models.

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Scaling TransNormer to 175 Billion Parameters.

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Fei Yuan, Xiao Luo, Yu Qiao, Yiran Zhong

CoRR, 2023

2021

The Relationship Between CT Signs of Computed Tomography and Risk Classification of Gastric Stromal Tumors.

Wang Chen, Rong Guo, Weigao Sun, Dingyou Lu

J. Medical Imaging Health Informatics, 2021

2020

Data-Driven Probabilistic Optimal Power Flow With Nonparametric Bayesian Modeling and Inference.

Weigao Sun, Mohsen Zamani, Mohammad Reza Hesamzadeh, Hai-Tao Zhang

IEEE Trans. Smart Grid, 2020

A Fast Optimal Power Flow Algorithm Using Powerball Method.

Hai-Tao Zhang, Weigao Sun, Yuanzheng Li, Dongfei Fu, Ye Yuan

IEEE Trans. Ind. Informatics, 2020

pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization.

Beitong Zhou, Jun Liu, Weigao Sun, Ruijuan Chen, Claire J. Tomlin, Ye Yuan

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

2019

Probabilistic Optimal Power Flow With Correlated Wind Power Uncertainty via Markov Chain Quasi-Monte-Carlo Sampling.

Weigao Sun, Mohsen Zamani, Hai-Tao Zhang, Yuanzheng Li

IEEE Trans. Ind. Informatics, 2019

A Nonparametric Bayesian Approach for Probabilistic Representation of Power Uncertainties.

Weigao Sun, Mohsen Zamani

Proceedings of the 2019 IEEE International Conference on Communications, 2019

2018

Probabilistic Optimal Power Flow Considering Correlation of Wind Farms via Markov Chain Quasi-Monte Carlo Sampling.

Weigao Sun, Mohsen Zamani, Hai-Tao Zhang, Yuanzheng Li

CoRR, 2018