Zach DeVito

According to our database, Zach DeVito authored at least 25 papers between 2010 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Is Flash Attention Stable?

Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

CoRR, 2024

Generative AI Beyond LLMs: System Implications of Multi-Modal Generation.

Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software, 2024

MAD-Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems.

Samuel Hsia, Alicia Golden, Bilge Acun, Newsha Ardalani, Zachary DeVito, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

Proceedings of the 51st ACM/IEEE Annual International Symposium on Computer Architecture, 2024

PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation.

Jason Ansel, Edward Z. Yang, Horace He, Natalia Gimelshein, Animesh Jain, Michael Voznesensky, Bin Bao, Peter Bell, David Berard, Evgeni Burovski, Geeta Chauhan, Anjali Chourdia, Will Constable, Alban Desmaison, Zachary DeVito, Elias Ellison, Will Feng, Jiong Gong, Michael Gschwind, Brian Hirsh, Sherlock Huang, Kshiteej Kalambarkar, Laurent Kirsch, Michael Lazos, Mario Lezcano, Yanbo Liang, Jason Liang, Yinghai Lu, C. K. Luk, Bert Maher, Yunjie Pan, Christian Puhrsch, Matthias Reso, Mark Saroufim, Marcos Yukio Siraichi, Helen Suk, Shunting Zhang, Michael Suo, Phil Tillet, Xu Zhao, Eikan Wang, Keren Zhou, Richard Zou, Xiaodong Wang, Ajit Mathews, William Wen, Gregory Chanan, Peng Wu, Soumith Chintala

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

2023

A Theory on Adam Instability in Large-Scale Machine Learning.

Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang

CoRR, 2023

PyTorch RPC: Distributed Deep Learning Built on Tensor-Optimized Remote Procedure Calls.

Shen Li, Pritam Damania, Luca Wehrstedt, Rohan Varma, Omkar Salpekar, Pavel Belevich, Howard Huang, Yanli Zhao, Lucas Hosseini, Wanchao Liang, Hongyi Jia, Shihao Xu, Satendra Gera, Alisson G. Azzolini, Guoqiang Jerry Chen, Zachary DeVito, Chaoyang He, Amir Ziashahabi, Alban Desmaison, Edward Z. Yang, Gregory Chanan, Brian Vaughan, Manoj Krishnan, Joseph S. Spisak, Salman Avestimehr, Soumith Chintala

Proceedings of the Sixth Conference on Machine Learning and Systems, 2023

2022

torch.fx: Practical Program Capture and Transformation for Deep Learning in Python.

James K. Reed, Zachary DeVito, Horace He, Ansley Ussery, Jason Ansel

Proceedings of the Fifth Conference on Machine Learning and Systems, 2022

2021

Using Python for Model Inference in Deep Learning.

Zachary DeVito, Jason Ansel, Will Constable, Michael Suo, Ailing Zhang, Kim M. Hazelwood

CoRR, 2021

2020

The Next 700 Accelerated Layers: From Mathematical Expressions of Network Computation Graphs to Accelerated GPU Kernels, Automatically.

Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen

ACM Trans. Archit. Code Optim., 2020

2019

PyTorch: An Imperative Style, High-Performance Deep Learning Library.

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, Soumith Chintala

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2018

Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions.

Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen

CoRR, 2018

2017

Opt: A Domain Specific Language for Non-Linear Least Squares Optimization in Graphics and Imaging.

Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner

ACM Trans. Graph., 2017

2016

Rigel: flexible multi-rate image processing hardware.

James Hegarty, Ross G. Daly, Zachary DeVito, Mark Horowitz, Pat Hanrahan, Jonathan Ragan-Kelley

ACM Trans. Graph., 2016

Ebb: A DSL for Physical Simulation on CPUs and GPUs.

Gilbert Louis Bernstein, Chinmayee Shah, Crystal Lemire, Zachary DeVito, Matthew Fisher, Philip Alexander Levis, Pat Hanrahan

ACM Trans. Graph., 2016

2015

Ebb: A DSL for Physical Simluation on CPUs and GPUs.

Gilbert Louis Bernstein, Chinmayee Shah, Crystal Lemire, Zachary DeVito, Matthew Fisher, Philip Alexander Levis, Pat Hanrahan

CoRR, 2015

The Design of Terra: Harnessing the Best Features of High-Level and Low-Level Languages.

Zachary DeVito, Pat Hanrahan

Proceedings of the 1st Summit on Advances in Programming Languages, 2015

2014

Terra: simplifying high-performance programming using multi-stage programming.

Zach DeVito

PhD thesis, 2014

Darkroom: compiling high-level image processing code into hardware pipelines.

James Hegarty, John S. Brunhaver, Zachary DeVito, Jonathan Ragan-Kelley, Noy Cohen, Steven Bell, Artem Vasilyev, Mark Horowitz, Pat Hanrahan

ACM Trans. Graph., 2014

Just-in-time Length Specialization of Dynamic Vector Code.

Justin Talbot, Zachary DeVito, Pat Hanrahan

Proceedings of the ARRAY'14: Proceedings of the 2014 ACM SIGPLAN International Workshop on Libraries, 2014

First-class runtime generation of high-performance types using exotypes.

Zachary DeVito, Daniel Ritchie, Matthew Fisher, Alex Aiken, Pat Hanrahan

Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation, 2014

2013

Terra: a multi-stage language for high-performance computing.

Zachary DeVito, James Hegarty, Alex Aiken, Pat Hanrahan, Jan Vitek

Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation, 2013

Exploring Traditional and Emerging Parallel Programming Models Using a Proxy Application.

Ian Karlin, Abhinav Bhatele, Jeff Keasler, Bradford L. Chamberlain, Jonathan D. Cohen, Zachary DeVito, Riyaz Haque, Dan Laney, Edward Luke, Felix Wang, David F. Richards, Martin Schulz, Charles H. Still

Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing, 2013

2012

Riposte: a trace-driven compiler and parallel VM for vector code in R.

Justin Talbot, Zachary DeVito, Pat Hanrahan

Proceedings of the International Conference on Parallel Architectures and Compilation Techniques, 2012

2011

Liszt: a domain specific language for building portable mesh-based PDE solvers.

Zach DeVito, Niels Joubert, Francisco Palacios, Stephen Oakley, Montserrat Medina, Mike Barrientos, Erich Elsen, Frank Ham, Alex Aiken, Karthik Duraisamy, Eric Darve, Juan J. Alonso, Pat Hanrahan

Proceedings of the Conference on High Performance Computing Networking, 2011

2010

Language virtualization for heterogeneous parallel computing.

Hassan Chafi, Zach DeVito, Adriaan Moors, Tiark Rompf, Arvind K. Sujeeth, Pat Hanrahan, Martin Odersky, Kunle Olukotun

Proceedings of the 25th Annual ACM SIGPLAN Conference on Object-Oriented Programming, 2010