Jiarui Fang

According to our database, Jiarui Fang authored at least 30 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

FDI-SIL.

Qin Su, Lei Shu, Qingsong Zhao, Zitian Jiang, Jiarui Fang

Dataset, March, 2024

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism.

Diandian Gu, Peng Sun, Qinghao Hu, Ting Huang, Xun Chen, Yingtong Xiong, Guoteng Wang, Qiaoling Chen, Shangchun Zhao, Jiarui Fang, Yonggang Wen, Tianwei Zhang, Xin Jin, Xuanzhe Liu

CoRR, 2024

PipeFusion: Displaced Patch Pipeline Parallelism for Inference of Diffusion Transformer Models.

Jiannan Wang, Jiarui Fang, Aoyu Li, PengCheng Yang

CoRR, 2024

USP: A Unified Sequence Parallelism Approach for Long Context Generative AI.

Jiarui Fang, Shangchun Zhao

CoRR, 2024

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference.

Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Jiarui Fang, Haotian Zhou, Bin Jia, Ziming Liu, Yang You

CoRR, 2024

FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters.

Shenggan Cheng, Xuanlei Zhao, Guangyang Lu, Jiarui Fang, Tian Zheng, Ruidong Wu, Xiwen Zhang, Jian Peng, Yang You

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

2023

Parallel Training of Pre-Trained Models via Chunk-Based Dynamic Memory Management.

Jiarui Fang, Zilin Zhu, Shenggui Li, Hui Su, Yang Yu, Jie Zhou, Yang You

IEEE Trans. Parallel Distributed Syst., 2023

Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models.

Yuliang Liu, Shenggui Li, Jiarui Fang, Yanjun Shao, Boyuan Yao, Yang You

CoRR, 2023

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training.

Shenggui Li, Hongxin Liu, Zhengda Bian, Jiarui Fang, Haichen Huang, Yuliang Liu, Boxiang Wang, Yang You

Proceedings of the 52nd International Conference on Parallel Processing, 2023

2022

Elixir: Train a Large Language Model on a Small GPU Cluster.

Haichen Huang, Jiarui Fang, Hongxin Liu, Shenggui Li, Yang You

CoRR, 2022

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models.

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

CoRR, 2022

A Frequency-aware Software Cache for Large Recommendation System Embeddings.

Jiarui Fang, Geng Zhang, Jiatong Han, Shenggui Li, Zhengda Bian, Yongbin Li, Jin Liu, Yang You

CoRR, 2022

RoCBert: Robust Chinese Bert with Multimodal Contrastive Pretraining.

Hui Su, Weiwei Shi, Xiaoyu Shen, Xiao Zhou, Tuo Ji, Jiarui Fang, Jie Zhou

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management.

Jiarui Fang, Yang Yu, Shenggui Li, Yang You, Jie Zhou

CoRR, 2021

TurboTransformers: an efficient GPU serving system for transformer models.

Jiarui Fang, Yang Yu, Chengduo Zhao, Jie Zhou

Proceedings of the PPoPP '21: 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2021

2020

Efficient AES implementation on Sunway TaihuLight supercomputer: A systematic approach.

Liandeng Li, Jiarui Fang, Jinlei Jiang, Lin Gan, Weijie Zheng, Haohuan Fu, Guangwen Yang

J. Parallel Distributed Comput., 2020

2019

Semantic Segmentation-Based Building Footprint Extraction Using Very High-Resolution Satellite Images and Multi-Source GIS Data.

Weijia Li, Conghui He, Jiarui Fang, Juepeng Zheng, Haohuan Fu, Le Yu

Remote. Sens., 2019

RedSync: Reducing synchronization bandwidth for distributed deep learning training system.

Jiarui Fang, Haohuan Fu, Guangwen Yang, Cho-Jui Hsieh

J. Parallel Distributed Comput., 2019

swATOP: Automatically Optimizing Deep Learning Operators on SW26010 Many-Core Processor.

Wei Gao, Jiarui Fang, Wenlai Zhao, Jinzhe Yang, Long Wang, Lin Gan, Haohuan Fu, Guangwen Yang

Proceedings of the 48th International Conference on Parallel Processing, 2019

2018

Optimizing Convolutional Neural Networks on the Sunway TaihuLight Supercomputer.

Wenlai Zhao, Haohuan Fu, Jiarui Fang, Weijie Zheng, Lin Gan, Guangwen Yang

ACM Trans. Archit. Code Optim., 2018

A dynamic agricultural prediction system for large-scale drought assessment on the Sunway TaihuLight supercomputer.

Xiao Huang, Chaoqing Yu, Jiarui Fang, Guorui Huang, Shaoqiang Ni, Jim W. Hall, Conrad Zorn, Xiaomeng Huang, Wenyuan Zhang

Comput. Electron. Agric., 2018

Semantic Segmentation Based Building Extraction Method Using Multi-Source GIS Map Datasets and Satellite Imagery.

Weijia Li, Conghui He, Jiarui Fang, Haohuan Fu

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018

swCaffe: A Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight.

Liandeng Li, Jiarui Fang, Haohuan Fu, Jinlei Jiang, Wenlai Zhao, Conghui He, Xin You, Guangwen Yang

Proceedings of the IEEE International Conference on Cluster Computing, 2018

2017

Parallel Multiclass Support Vector Machine for Remote Sensing Data Classification on Multicore and Many-Core Architectures.

Weijia Li, Haohuan Fu, Yang You, Le Yu, Jiarui Fang

IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2017

SW-AES: Accelerating AES Algorithm on the Sunway TaihuLight.

Liandeng Li, Jiarui Fang, Jinlei Jiang, Lin Gan, Weijie Zheng, Haohuan Fu, Guangwen Yang

Proceedings of the 2017 IEEE International Symposium on Parallel and Distributed Processing with Applications and 2017 IEEE International Conference on Ubiquitous Computing and Communications (ISPA/IUCC), 2017

swDNN: A Library for Accelerating Deep Learning Applications on Sunway TaihuLight.

Jiarui Fang, Haohuan Fu, Wenlai Zhao, Bingwei Chen, Weijie Zheng, Guangwen Yang

Proceedings of the 2017 IEEE International Parallel and Distributed Processing Symposium, 2017

2016

Refactoring and optimizing the community atmosphere model (CAM) on the sunway taihulight supercomputer.

Haohuan Fu, Junfeng Liao, Wei Xue, Lanning Wang, Dexun Chen, Long Gu, Jinxiu Xu, Nan Ding, Xinliang Wang, Conghui He, Shizhen Xu, Yishuang Liang, Jiarui Fang, Yuanchao Xu, Weijie Zheng, Jingheng Xu, Zhen Zheng, Wanjing Wei, Xu Ji, He Zhang, Bingwei Chen, Kaiwei Li, Xiaomeng Huang, Wenguang Chen, Guangwen Yang

Proceedings of the International Conference for High Performance Computing, 2016

Cache-Friendly Design for Complex Spatially-Variable Coefficient Stencils on Many-Core Architectures.

Jiarui Fang, Haohuan Fu, Guangwen Yang

Proceedings of the 23rd IEEE International Conference on High Performance Computing, 2016

2015

Optimizing Complex Spatially-Variant Coefficient Stencils for Seismic Modeling on GPU.

Jiarui Fang, Haohuan Fu, He Zhang, Wei Wu, Nanxun Dai, Lin Gan, Guangwen Yang

Proceedings of the 21st IEEE International Conference on Parallel and Distributed Systems, 2015

2013

Sourcing strategies in supply risk management: An approximate dynamic programming approach.

Jiarui Fang, Lei Zhao, Jan C. Fransoo, Tom Van Woensel

Comput. Oper. Res., 2013