Less Wright

According to our database, Less Wright authored at least 5 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training.

Wanchao Liang, Tianyu Liu, Less Wright, Will Constable, Andrew Gu, Chien-Chin Huang, Iris Zhang, Wei Feng, Howard Huang, Junjie Wang, Sanket Purandare, Gokul Nadathur, Stratos Idreos

CoRR, 2024

Accelerating a Triton Fused Kernel for W4A16 Quantized Inference with SplitK work decomposition.

Adnan Hoque, Less Wright, Chih-Chieh Yang, Mudhakar Srivatsa, Raghu K. Ganti

CoRR, 2024

2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Ajit Mathews, Shen Li

Proc. VLDB Endow., 2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Shen Li

CoRR, 2023

2021

Ranger21: a synergistic deep learning optimizer.

Less Wright, Nestor Demeure

CoRR, 2021