2024
DeepSeek-V3 Technical Report.
[DOI]
DeepSeek-AI
,
Aixin Liu
,
Bei Feng
,
Bing Xue
,
Bingxuan Wang
,
Bochao Wu
,
Chengda Lu
,
Chenggang Zhao
,
Chengqi Deng
,
Chenyu Zhang
,
Chong Ruan
,
Damai Dai
,
Daya Guo
,
Dejian Yang
,
Deli Chen
,
Dongjie Ji
,
Erhang Li
,
Fangyun Lin
,
Fucong Dai
,
Fuli Luo
,
Guangbo Hao
,
Guanting Chen
,
Guowei Li
,
H. Zhang
,
Han Bao
,
Hanwei Xu
,
Haocheng Wang
,
Haowei Zhang
,
Honghui Ding
,
Huajian Xin
,
Huazuo Gao
,
Hui Li
,
Hui Qu
,
J. L. Cai
,
Jian Liang
,
Jianzhong Guo
,
Jiaqi Ni
,
Jiashi Li
,
Jiawei Wang
,
Jin Chen
,
Jingchang Chen
,
Jingyang Yuan
,
Junjie Qiu
,
Junlong Li
,
Junxiao Song
,
Kai Dong
,
Kai Hu
,
Kaige Gao
,
Kang Guan
,
Kexin Huang
,
Kuai Yu
,
Lean Wang
,
Lecong Zhang
,
Lei Xu
,
Leyi Xia
,
Liang Zhao
,
Litong Wang
,
Liyue Zhang
,
Meng Li
,
Miaojun Wang
,
Mingchuan Zhang
,
Minghua Zhang
,
Minghui Tang
,
Mingming Li
,
Ning Tian
,
Panpan Huang
,
Peiyi Wang
,
Peng Zhang
,
Qiancheng Wang
,
Qihao Zhu
,
Qinyu Chen
,
Qiushi Du
,
R. J. Chen
,
R. L. Jin
,
Ruiqi Ge
,
Ruisong Zhang
,
Ruizhe Pan
,
Runji Wang
,
Runxin Xu
,
Ruoyu Zhang
,
Ruyi Chen
,
S. S. Li
,
Shanghao Lu
,
Shangyan Zhou
,
Shanhuang Chen
,
Shaoqing Wu
,
Shengfeng Ye
,
Shengfeng Ye
,
Shirong Ma
,
Shiyu Wang
,
Shuang Zhou
,
Shuiping Yu
,
Shunfeng Zhou
,
Shuting Pan
,
T. Wang
,
Tao Yun
,
Tian Pei
,
Tianyu Sun
,
W. L. Xiao
,
Wangding Zeng
CoRR, 2024

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning.
[DOI]
Wei An
,
Xiao Bi
,
Guanting Chen
,
Shanhuang Chen
,
Chengqi Deng
,
Honghui Ding
,
Kai Dong
,
Qiushi Du
,
Wenjun Gao
,
Kang Guan
,
Jianzhong Guo
,
Yongqiang Guo
,
Zhe Fu
,
Ying He
,
Panpan Huang
,
Jiashi Li
,
Wenfeng Liang
,
Xiaodong Liu
,
Xin Liu
,
Yiyuan Liu
,
Yuxuan Liu
,
Shanghao Lu
,
Xuan Lu
,
Xiaotao Nie
,
Tian Pei
,
Junjie Qiu
,
Hui Qu
,
Zehui Ren
,
Zhangli Sha
,
Xuecheng Su
,
Xiaowen Sun
,
Yixuan Tan
,
Minghui Tang
,
Shiyu Wang
,
Yaohui Wang
,
Yongji Wang
,
Ziwei Xie
,
Yiliang Xiong
,
Yanhong Xu
,
Shengfeng Ye
,
Shuiping Yu
,
Yukun Zhang
,
Liyue Zhang
,
Haowei Zhang
,
Mingchuan Zhang
,
Wentao Zhang
,
Yichao Zhang
,
Chenggang Zhao
,
Yao Zhao
,
Shangyan Zhou
,
Shunfeng Zhou
,
Yuheng Zou
CoRR, 2024

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model.
[DOI]
DeepSeek-AI
,
Aixin Liu
,
Bei Feng
,
Bin Wang
,
Bingxuan Wang
,
Bo Liu
,
Chenggang Zhao
,
Chengqi Deng
,
Chong Ruan
,
Damai Dai
,
Daya Guo
,
Dejian Yang
,
Deli Chen
,
Dongjie Ji
,
Erhang Li
,
Fangyun Lin
,
Fuli Luo
,
Guangbo Hao
,
Guanting Chen
,
Guowei Li
,
Hao Zhang
,
Hanwei Xu
,
Hao Yang
,
Haowei Zhang
,
Honghui Ding
,
Huajian Xin
,
Huazuo Gao
,
Hui Li
,
Hui Qu
,
J. L. Cai
,
Jian Liang
,
Jianzhong Guo
,
Jiaqi Ni
,
Jiashi Li
,
Jin Chen
,
Jingyang Yuan
,
Junjie Qiu
,
Junxiao Song
,
Kai Dong
,
Kaige Gao
,
Kang Guan
,
Lean Wang
,
Lecong Zhang
,
Lei Xu
,
Leyi Xia
,
Liang Zhao
,
Liyue Zhang
,
Meng Li
,
Miaojun Wang
,
Mingchuan Zhang
,
Minghua Zhang
,
Minghui Tang
,
Mingming Li
,
Ning Tian
,
Panpan Huang
,
Peiyi Wang
,
Peng Zhang
,
Qihao Zhu
,
Qinyu Chen
,
Qiushi Du
,
R. J. Chen
,
R. L. Jin
,
Ruiqi Ge
,
Ruizhe Pan
,
Runxin Xu
,
Ruyi Chen
,
S. S. Li
,
Shanghao Lu
,
Shangyan Zhou
,
Shanhuang Chen
,
Shaoqing Wu
,
Shengfeng Ye
,
Shirong Ma
,
Shiyu Wang
,
Shuang Zhou
,
Shuiping Yu
,
Shunfeng Zhou
,
Size Zheng
,
Tao Wang
,
Tian Pei
,
Tian Yuan
,
Tianyu Sun
,
W. L. Xiao
,
Wangding Zeng
,
Wei An
,
Wen Liu
,
Wenfeng Liang
,
Wenjun Gao
,
Wentao Zhang
,
X. Q. Li
,
Xiangyue Jin
,
Xianzu Wang
,
Xiao Bi
,
Xiaodong Liu
,
Xiaohan Wang
,
Xiaojin Shen
,
Xiaokang Chen
,
Xiaosha Chen
,
Xiaotao Nie
,
Xiaowen Sun
CoRR, 2024

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.
[DOI]
Xiao Bi
,
Deli Chen
,
Guanting Chen
,
Shanhuang Chen
,
Damai Dai
,
Chengqi Deng
,
Honghui Ding
,
Kai Dong
,
Qiushi Du
,
Zhe Fu
,
Huazuo Gao
,
Kaige Gao
,
Wenjun Gao
,
Ruiqi Ge
,
Kang Guan
,
Daya Guo
,
Jianzhong Guo
,
Guangbo Hao
,
Zhewen Hao
,
Ying He
,
Wenjie Hu
,
Panpan Huang
,
Erhang Li
,
Guowei Li
,
Jiashi Li
,
Yao Li
,
Y. K. Li
,
Wenfeng Liang
,
Fangyun Lin
,
Alex X. Liu
,
Bo Liu
,
Wen Liu
,
Xiaodong Liu
,
Xin Liu
,
Yiyuan Liu
,
Haoyu Lu
,
Shanghao Lu
,
Fuli Luo
,
Shirong Ma
,
Xiaotao Nie
,
Tian Pei
,
Yishi Piao
,
Junjie Qiu
,
Hui Qu
,
Tongzheng Ren
,
Zehui Ren
,
Chong Ruan
,
Zhangli Sha
,
Zhihong Shao
,
Junxiao Song
,
Xuecheng Su
,
Jingxiang Sun
,
Yaofeng Sun
,
Minghui Tang
,
Bingxuan Wang
,
Peiyi Wang
,
Shiyu Wang
,
Yaohui Wang
,
Yongji Wang
,
Tong Wu
,
Y. Wu
,
Xin Xie
,
Zhenda Xie
,
Ziwei Xie
,
Yiliang Xiong
,
Hanwei Xu
,
R. X. Xu
,
Yanhong Xu
,
Dejian Yang
,
Yuxiang You
,
Shuiping Yu
,
Xingkai Yu
,
B. Zhang
,
Haowei Zhang
,
Lecong Zhang
,
Liyue Zhang
,
Mingchuan Zhang
,
Minghua Zhang
,
Wentao Zhang
,
Yichao Zhang
,
Chenggang Zhao
,
Yao Zhao
,
Shangyan Zhou
,
Shunfeng Zhou
,
Qihao Zhu
,
Yuheng Zou
CoRR, 2024

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning.
[DOI]
Wei An
,
Xiao Bi
,
Guanting Chen
,
Shanhuang Chen
,
Chengqi Deng
,
Honghui Ding
,
Kai Dong
,
Qiushi Du
,
Wenjun Gao
,
Kang Guan
,
Jianzhong Guo
,
Yongqiang Guo
,
Zhe Fu
,
Ying He
,
Panpan Huang
,
Jiashi Li
,
Wenfeng Liang
,
Xiaodong Liu
,
Xin Liu
,
Yiyuan Liu
,
Yuxuan Liu
,
Shanghao Lu
,
Xuan Lu
,
Xiaotao Nie
,
Tian Pei
,
Junjie Qiu
,
Hui Qu
,
Zehui Ren
,
Zhangli Sha
,
Xuecheng Su
,
Xiaowen Sun
,
Yixuan Tan
,
Minghui Tang
,
Shiyu Wang
,
Yaohui Wang
,
Yongji Wang
,
Ziwei Xie
,
Yiliang Xiong
,
Yanhong Xu
,
Shengfeng Ye
,
Shuiping Yu
,
Yukun Zha
,
Liyue Zhang
,
Haowei Zhang
,
Mingchuan Zhang
,
Wentao Zhang
,
Yichao Zhang
,
Chenggang Zhao
,
Yao Zhao
,
Shangyan Zhou
,
Shunfeng Zhou
,
Yuheng Zou
Proceedings of the International Conference for High Performance Computing, 2024