Mostafa Elhoushi

According to our database, Mostafa Elhoushi authored at least 27 papers between 2014 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training.

Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn

CoRR, 2024

PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context.

Maximilian Augustin, Syed Shakib Sarwar, Mostafa Elhoushi, Sai Qian Zhang, Yuecheng Li, Barbara De Salvo

CoRR, 2024

Characterizing and Efficiently Accelerating Multimodal Generation Model Inference.

Yejin Lee, Anna Y. Sun, Basil Hosmer, Bilge Acun, Can Balioglu, Changhan Wang, Charles David Hernandez, Christian Puhrsch, Daniel Haziza, Driss Guessous, Francisco Massa, Jacob Kahn, Jeffrey Wan, Jeremy Reizenstein, Jiaqi Zhai, Joe Isaacson, Joel Schlosser, Juan Pino, Kaushik Ram Sadagopan, Leonid Shamis, Linjian Ma, Min-Jae Hwang, Mingda Chen, Mostafa Elhoushi, Pedro Rodriguez, Ram Pasunuru, Scott Yih, Sravya Popuri, Xing Liu, Carole-Jean Wu

CoRR, 2024

Brevity is the soul of wit: Pruning long files for code generation.

Aaditya K. Singh, Yu Yang, Kushal Tirumala, Mostafa Elhoushi, Ari S. Morcos

CoRR, 2024

Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks.

Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung

Proceedings of the Forty-first International Conference on Machine Learning, 2024

AST-T5: Structure-Aware Pretraining for Code Generation and Understanding.

Linyuan Gong, Mostafa Elhoushi, Alvin Cheung

Proceedings of the Forty-first International Conference on Machine Learning, 2024

CHAI: Clustered Head Attention for Efficient LLM Inference.

Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Minuet: Accelerating 3D Sparse Convolutions on GPUs.

Jiacheng Yang, Christina Giannoula, Jun Wu, Mostafa Elhoushi, James Gleeson, Gennady Pekhimenko

Proceedings of the Nineteenth European Conference on Computer Systems, 2024

Sieve: Multimodal Dataset Pruning Using Image Captioning Models.

Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, Ari S. Morcos

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding.

Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, Bilge Acun, Saurabh Agarwal, Ahmed Roman, Ahmed A Aly, Beidi Chen, Carole-Jean Wu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Decoding Data Quality via Synthetic Corruptions: Embedding-guided Pruning of Code Data.

Yu Yang, Aaditya K. Singh, Mostafa Elhoushi, Anas Mahmoud, Kushal Tirumala, Fabian Gloeckle, Baptiste Rozière, Carole-Jean Wu, Ari S. Morcos, Newsha Ardalani

CoRR, 2023

Large Language Models for Compiler Optimization.

Chris Cummins, Volker Seeker, Dejan Grubisic, Mostafa Elhoushi, Youwei Liang, Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, Kim M. Hazelwood, Gabriel Synnaeve, Hugh Leather

CoRR, 2023

MODeL: Memory Optimizations for Deep Learning.

Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty

Proceedings of the International Conference on Machine Learning, 2023

Learning Compiler Pass Orders using Coreset and Normalized Value Prediction.

Youwei Liang, Kevin Stone, Ali Shameli, Chris Cummins, Mostafa Elhoushi, Jiadong Guo, Benoit Steiner, Xiaomeng Yang, Pengtao Xie, Hugh James Leather, Yuandong Tian

Proceedings of the International Conference on Machine Learning, 2023

2022

OLLA: Decreasing the Memory Usage of Neural Networks by Optimizing the Lifetime and Location of Arrays.

Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty

CoRR, 2022

MLGOPerf: An ML Guided Inliner to Optimize Performance.

Amir H. Ashouri, Mostafa Elhoushi, Yuzhe Hua, Xiang Wang, Muhammad Asif Manzoor, Bryan Chan, Yaoqing Gao

CoRR, 2022

Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction.

Sara Elkerdawy, Mostafa Elhoushi, Hong Zhang, Nilanjan Ray

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Work-in-Progress: MLGOPerf: An ML Guided Inliner to Optimize Performance.

Amir H. Ashouri, Mostafa Elhoushi, Yuzhe Hua, Xiang Wang, Muhammad Asif Manzoor, Bryan Chan, Yaoqing Gao

Proceedings of the International Conference on Compilers, 2022

2021

Layer Importance Estimation With Imprinting for Neural Network Quantization.

Hongyang Liu, Sara Elkerdawy, Nilanjan Ray, Mostafa Elhoushi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2021

DeepShift: Towards Multiplication-Less Neural Networks.

Mostafa Elhoushi, Zihao Chen, Farhan Shafiq, Ye Henry Tian, Joey Yiwei Li

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2021

2020

One-Shot Layer-Wise Accuracy Approximation For Layer Pruning.

Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang, Nilanjan Ray

Proceedings of the IEEE International Conference on Image Processing, 2020

To Filter Prune, or to Layer Prune, That Is the Question.

Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang, Nilanjan Ray

Proceedings of the Computer Vision - ACCV 2020 - 15th Asian Conference on Computer Vision, Kyoto, Japan, November 30, 2020

2019

Accelerating Training using Tensor Decomposition.

Mostafa Elhoushi, Ye Henry Tian, Zihao Chen, Farhan Shafiq, Joey Yiwei Li

CoRR, 2019

2017

A Survey on Approaches of Motion Mode Recognition Using Sensors.

Mostafa Elhoushi, Jacques Georgy, Aboelmagd Noureldin, Michael J. Korenberg

IEEE Trans. Intell. Transp. Syst., 2017

2016

Motion Mode Recognition for Indoor Pedestrian Navigation Using Portable Devices.

Mostafa Elhoushi, Jacques Georgy, Aboelmagd Noureldin, Michael J. Korenberg

IEEE Trans. Instrum. Meas., 2016

2014

Model of a hybrid processor executing C++ with additional quantum functions.

Mostafa Elhoushi, M. Watheq El-Kharashi, Hatem Elrefaei

Microprocess. Microsystems, 2014

Using portable device sensors to recognize height changing modes of motion.

Mostafa Elhoushi, Jacques Georgy, Ahmed Wahdan, Michael J. Korenberg, Aboelmagd Noureldin

Proceedings of the IEEE International Instrumentation and Measurement Technology Conference, 2014