DistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models. - Zili Zhang; Yinmin Zhong; Ranchen Ming; Hanpeng Hu; Jianjian Sun; Zheng Ge; Yibo Zhu; Xin Jin 008 (CoRR, 2024)

RLHFuse: Efficient RLHF Training for Large Language Models with Inter- and Intra-Stage Fusion. - Yinmin Zhong; Zili Zhang; Bingyang Wu; Shengyu Liu; Yukun Chen; Changyi Wan; Hanpeng Hu; Lei Xia; Ranchen Ming; Yibo Zhu; Xin Jin 008 (CoRR, 2024)