Saeed Maleki

According to our database, Saeed Maleki authored at least 39 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

Efficient Schedule Construction for Distributed Execution of Large DNN Models.

Zhiqi Lin, Youshan Miao, Guanbin Xu, Cheng Li, Olli Saarikivi, Saeed Maleki, Fan Yang

IEEE Trans. Parallel Distributed Syst., December, 2024

ForestColl: Efficient Collective Communications on Heterogeneous Network Fabrics.

Liangyu Zhao, Saeed Maleki, Ziyue Yang, Hossein Pourreza, Aashaka Shah, Changho Hwang, Arvind Krishnamurthy

CoRR, 2024

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training.

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

Splitwise: Efficient Generative LLM Inference Using Phase Splitting.

Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini

Proceedings of the 51st ACM/IEEE Annual International Symposium on Computer Architecture, 2024

Tessel: Boosting Distributed Execution of Large DNN Models via Flexible Schedule Search.

Zhiqi Lin, Youshan Miao, Guanbin Xu, Cheng Li, Olli Saarikivi, Saeed Maleki, Fan Yang

Proceedings of the IEEE International Symposium on High-Performance Computer Architecture, 2024

Aceso: Efficient Parallel DNN Training through Iterative Bottleneck Alleviation.

Guodong Liu, Youshan Miao, Zhiqi Lin, Xiaoxiang Shi, Saeed Maleki, Fan Yang, Yungang Bao, Sa Wang

Proceedings of the Nineteenth European Conference on Computer Systems, 2024

A Framework for Fine-Grained Synchronization of Dependent GPU Kernels.

Abhinav Jangda, Saeed Maleki, Maryam Mehri Dehnavi, Madan Musuvathi, Olli Saarikivi

Proceedings of the IEEE/ACM International Symposium on Code Generation and Optimization, 2024

2023

Look-Up mAI GeMM: Increasing AI GeMMs Performance by Nearly 2.5x via msGeMM.

Saeed Maleki

CoRR, 2023

Rethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem.

Behnaz Arzani, Siva Kesava Reddy Kakarla, Miguel Castro, Srikanth Kandula, Saeed Maleki, Luke Marshall

CoRR, 2023

SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction.

Zhiqi Lin, Youshan Miao, Guodong Liu, Xiaoxiang Shi, Quanlu Zhang, Fan Yang, Saeed Maleki, Yi Zhu, Xu Cao, Cheng Li, Mao Yang, Lintao Zhang, Lidong Zhou

CoRR, 2023

TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches.

Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi

Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation, 2023

MSCCLang: Microsoft Collective Communication Language.

Meghan Cowan, Saeed Maleki, Madanlal Musuvathi, Olli Saarikivi, Yifan Xiong

Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2023

2022

Error-Covariance Analysis of Monocular Pose Estimation Using Total Least Squares.

Saeed Maleki, John L. Crassidis, Yang Cheng, Matthias Schmid

CoRR, 2022

Optimal Pose Estimation and Covariance Analysis with Simultaneous Localization and Mapping Applications.

Saeed Maleki, Adhiti Raman, Yang Cheng, John L. Crassidis, Matthias Schmid

CoRR, 2022

MSCCL: Microsoft Collective Communication Library.

Meghan Cowan, Saeed Maleki, Madanlal Musuvathi, Olli Saarikivi, Yifan Xiong

CoRR, 2022

Breaking the computation and communication abstraction barrier in distributed machine learning workloads.

Abhinav Jangda, Jun Huang, Guodong Liu, Amir Hossein Nodehi Sabet, Saeed Maleki, Youshan Miao, Madanlal Musuvathi, Todd Mytkowicz, Olli Saarikivi

Proceedings of the ASPLOS '22: 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Lausanne, Switzerland, 28 February 2022, 2022

2021

Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL.

Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh

CoRR, 2021

Total Least Squares for Optimal Pose Estimation.

Saeed Maleki, John L. Crassidis, Yang Cheng, Matthias Schmid

CoRR, 2021

CoCoNet: Co-Optimizing Computation and Communication for Distributed Machine Learning.

Abhinav Jangda, Jun Huang, Guodong Liu, Amir Hossein Nodehi Sabet, Saeed Maleki, Youshan Miao, Madanlal Musuvathi, Todd Mytkowicz, Olli Saarikivi

CoRR, 2021

Synthesizing optimal collective algorithms.

Zixian Cai, Zhengyang Liu, Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi

Proceedings of the PPoPP '21: 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2021

Scaling Distributed Training with Adaptive Summation.

Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Olli Saarikivi, Tianju Xu, Vadim Eksarevskiy, Jaliya Ekanayake, Emad Barsoum

Proceedings of the Fourth Conference on Machine Learning and Systems, 2021

Distributed Training of Embeddings using Graph Analytics.

Gurbinder Gill, Roshan Dathathri, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Olli Saarikivi

Proceedings of the 35th IEEE International Parallel and Distributed Processing Symposium, 2021

2019

Distributed Word2Vec using Graph Analytics Frameworks.

Gurbinder Gill, Roshan Dathathri, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Olli Saarikivi

CoRR, 2019

CHET: an optimizing compiler for fully-homomorphic neural-network inferencing.

Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin E. Lauter, Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation, 2019

2018

An empirical study of the effect of source-level loop transformations on compiler stability.

Zhangxiaowen Gong, Zhi Chen, Justin Josef Szaday, David C. Wong, Zehra Sura, Neftali Watkinson, Saeed Maleki, David A. Padua, Alexander V. Veidenbaum, Alexandru Nicolau, Josep Torrellas

Proc. ACM Program. Lang., 2018

CHET: Compiler and Runtime for Homomorphic Evaluation of Tensor Programs.

Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin E. Lauter, Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

CoRR, 2018

Semantics-Preserving Parallelization of Stochastic Gradient Descent.

Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

Proceedings of the 2018 IEEE International Parallel and Distributed Processing Symposium, 2018

2017

Parallel Stochastic Gradient Descent with Sound Combiners.

Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

CoRR, 2017

LORE: A loop repository for the evaluation of compilers.

Zhi Chen, Zhangxiaowen Gong, Justin Josef Szaday, David C. Wong, David A. Padua, Alexandru Nicolau, Alexander V. Veidenbaum, Neftali Watkinson, Zehra Sura, Saeed Maleki, Josep Torrellas, Gerald DeJong

Proceedings of the 2017 IEEE International Symposium on Workload Characterization, 2017

2016

Low-Rank Methods for Parallelizing Dynamic Programming Algorithms.

Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

ACM Trans. Parallel Comput., 2016

Efficient parallelization using rank convergence in dynamic programming algorithms.

Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

Commun. ACM, 2016

DSMR: a shared and distributed memory algorithm for single-source shortest path problem.

Saeed Maleki, Donald Nguyen, Andrew Lenharth, María Jesús Garzarán, David A. Padua, Keshav Pingali

Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2016

DSMR: A Parallel Algorithm for Single-Source Shortest Path Problem.

Saeed Maleki, Donald Nguyen, Andrew Lenharth, María Jesús Garzarán, David A. Padua, Keshav Pingali

Proceedings of the 2016 International Conference on Supercomputing, 2016

Parallelizing WFST speech decoders.

Charith Mendis, Jasha Droppo, Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz, Geoffrey Zweig

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

Communication avoiding parallel algorithms for amorphous problems

Saeed Maleki

PhD thesis, 2015

2014

Parallelizing dynamic programming through rank convergence.

Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2014

Tiled Linear Algebra a System for Parallel Graph Algorithms.

Saeed Maleki, G. Carl Evans, David A. Padua

Proceedings of the Languages and Compilers for Parallel Computing, 2014

2012

Performance Portability with the Chapel Language.

Albert Sidelnik, Saeed Maleki, Bradford L. Chamberlain, María Jesús Garzarán, David A. Padua

Proceedings of the 26th IEEE International Parallel and Distributed Processing Symposium, 2012

2011

An Evaluation of Vectorizing Compilers.

Saeed Maleki, Yaoqing Gao, María Jesús Garzarán, Tommy Wong, David A. Padua

Proceedings of the 2011 International Conference on Parallel Architectures and Compilation Techniques, 2011