Yuxiong He

According to our database, Yuxiong He authored at least 141 papers between 2004 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation.

Aurick Qiao, Zhewei Yao, Samyam Rajbhandari, Yuxiong He

CoRR, 2024

STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning.

Jaeseong Lee, Seung-won Hwang, Aurick Qiao, Daniel F. Campos, Zhewei Yao, Yuxiong He

CoRR, 2024

FastPersist: Accelerating Model Checkpointing in Deep Learning.

Guanhua Wang, Olatunji Ruwase, Bing Xie, Yuxiong He

CoRR, 2024

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design.

Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song

CoRR, 2024

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference.

Connor Holmes, Masahiro Tanaka, Michael Wyatt, Ammar Ahmad Awan, Jeff Rasley, Samyam Rajbhandari, Reza Yazdani Aminabadi, Heyang Qin, Arash Bakhtiari, Lev Kurilenko, Yuxiong He

CoRR, 2024

Quant-LLM: Accelerating the Serving of Large Language Models via FP6-Centric Algorithm-System Co-Design on Modern GPUs.

Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song

Proceedings of the 2024 USENIX Annual Technical Conference, 2024

System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models.

Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminadabi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He

Proceedings of the 43rd ACM Symposium on Principles of Distributed Computing, 2024

System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models.

Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminabadi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He

Proceedings of the IEEE International Parallel and Distributed Processing Symposium, 2024

ZeRO++: Extremely Efficient Collective Communication for Large Model Training.

Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation.

Zhewei Yao, Xiaoxia Wu, Cheng Li, Stephen Youn, Yuxiong He

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing.

Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Connor Holmes, Cheng Li, Yuxiong He

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks.

Reza Yazdani Aminabadi, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González

ACM Trans. Embed. Comput. Syst., March, 2023

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks.

Xiaoxia Wu, Haojun Xia, Stephen Youn, Zhen Zheng, Shiyang Chen, Arash Bakhtiari, Michael Wyatt, Reza Yazdani Aminabadi, Yuxiong He, Olatunji Ruwase, Leon Song, Zhewei Yao

CoRR, 2023

ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Training Quantization Framework for W8A8 Transformers.

Zhewei Yao, Reza Yazdani Aminabadi, Stephen Youn, Xiaoxia Wu, Elton Zheng, Yuxiong He

CoRR, 2023

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies.

Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan A. Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael W. Irvin, J. Gregory Pauloski, Logan T. Ward, Valérie Hayot-Sasson, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian T. Foster, James J. Davis, Michael E. Papka, Thomas S. Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi A. Hanson, Thomas E. Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton D. Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin M. Aji, Angela Dalton, Michael J. Schulte, Karl Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens

CoRR, 2023

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models.

Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He

CoRR, 2023

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention.

Zhewei Yao, Xiaoxia Wu, Conglong Li, Minjia Zhang, Heyang Qin, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He

CoRR, 2023

RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model.

Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song

CoRR, 2023

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.

Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He

CoRR, 2023

ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats.

Xiaoxia Wu, Zhewei Yao, Yuxiong He

CoRR, 2023

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.

Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

CoRR, 2023

Selective Guidance: Are All the Denoising Steps of Guided Diffusion Important?

Pareesa Ameneh Golnari, Zhewei Yao, Yuxiong He

CoRR, 2023

A Comprehensive Study on Post-Training Quantization for Large Language Models.

Zhewei Yao, Cheng Li, Xiaoxia Wu, Stephen Youn, Yuxiong He

CoRR, 2023

A Novel Tensor-Expert Hybrid Parallelism Approach to Scale Mixture-of-Experts Training.

Siddharth Singh, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He, Abhinav Bhatele

CoRR, 2023

Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases.

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

CoRR, 2023

MCR-DL: Mix-and-Match Communication Runtime for Deep Learning.

Quentin Anthony, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He, Aamir Shafi, Mustafa Abduljabbar, Hari Subramoni, Dhabaleswar K. Panda

Proceedings of the IEEE International Parallel and Distributed Processing Symposium, 2023

A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training.

Siddharth Singh, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He, Abhinav Bhatele

Proceedings of the 37th International Conference on Supercomputing, 2023

HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs.

Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao

Proceedings of the 37th International Conference on Supercomputing, 2023

Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases.

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

Proceedings of the International Conference on Machine Learning, 2023

DySR: Adaptive Super-Resolution via Algorithm and System Co-design.

Syed Zawad, Cheng Li, Zhewei Yao, Elton Zheng, Yuxiong He, Feng Yan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam.

Yucheng Lu, Conglong Li, Minjia Zhang, Christopher De Sa, Yuxiong He

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Scaling Vision-Language Models with Sparse Mixture of Experts.

Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Revisiting the Efficiency-Accuracy Tradeoff in Adapting Transformer Models via Adversarial Fine-Tuning.

Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He

Proceedings of the ECAI 2023 - 26th European Conference on Artificial Intelligence, September 30 - October 4, 2023, Kraków, Poland, 2023

2022

DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing.

Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Yuxiong He

CoRR, 2022

Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers.

Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He

CoRR, 2022

BiFeat: Supercharge GNN Training via Graph Feature Quantization.

Yuxin Ma, Ping Gong, Jun Yi, Zhewei Yao, Minjie Wang, Cheng Li, Yuxiong He, Feng Yan

CoRR, 2022

Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding.

Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu

CoRR, 2022

Extreme Compression for Pre-trained Transformers Made Simple and Efficient.

Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He

CoRR, 2022

ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise.

Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He

CoRR, 2022

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro

CoRR, 2022

GraSP: Optimizing Graph-based Nearest Neighbor Search with Subgraph Sampling and Pruning.

Minjia Zhang, Wenhan Wang, Yuxiong He

Proceedings of the WSDM '22: The Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event / Tempe, AZ, USA, February 21, 2022

DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale.

Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Olatunji Ruwase, Shaden Smith, Minjia Zhang, Jeff Rasley, Yuxiong He

Proceedings of the SC22: International Conference for High Performance Computing, 2022

ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers.

Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient.

Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models.

Conglong Li, Minjia Zhang, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale.

Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He

Proceedings of the International Conference on Machine Learning, 2022

1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed.

Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He

Proceedings of the 29th IEEE International Conference on High Performance Computing, 2022

Task Offloading Based on GRU Model in IoT.

Xiao Zhang, Yuxiong He, Youhuai Wang, Xiaoming Chen, Shi Jin, Ye Liang

Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering, 2022

Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers.

Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Scalable and Efficient MoE Training for Multitask Multilingual Models.

Young Jin Kim, Ammar Ahmad Awan, Alexandre Muzio, Andrés Felipe Cruz-Salinas, Liyang Lu, Amr Hendy, Samyam Rajbhandari, Yuxiong He, Hany Hassan Awadalla

CoRR, 2021

Curriculum Learning: A Regularization Method for Efficient and Stable Billion-Scale GPT Model Pre-Training.

Conglong Li, Minjia Zhang, Yuxiong He

CoRR, 2021

ZeRO-Offload: Democratizing Billion-Scale Model Training.

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, Yuxiong He

Proceedings of the 2021 USENIX Annual Technical Conference, 2021

ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning.

Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He

Proceedings of the International Conference for High Performance Computing, 2021

SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement.

Heyang Qin, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM.

Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.

Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He

Proceedings of the 38th International Conference on Machine Learning, 2021

2020

Fast LSTM by dynamic decomposition on cloud and distributed systems.

Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel

Knowl. Inf. Syst., 2020

Local trend discovery on real-time microblogs with uncertain locations in tight memory environments.

Abdulaziz Almaslukh, Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath, Walid G. Aref

GeoInformatica, 2020

APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm.

Hanlin Tang, Shaoduo Gan, Samyam Rajbhandari, Xiangru Lian, Ji Liu, Yuxiong He, Ce Zhang

CoRR, 2020

Improving Approximate Nearest Neighbor Search through Learned Adaptive Early Termination.

Conglong Li, Minjia Zhang, David G. Andersen, Yuxiong He

Proceedings of the 2020 International Conference on Management of Data, 2020

ZeRO: memory optimizations toward training trillion parameter models.

Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He

Proceedings of the International Conference for High Performance Computing, 2020

Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping.

Minjia Zhang, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

DeepSpeed: System Optimizations Enable Training Deep Learning Models with Over 100 Billion Parameters.

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, Yuxiong He

Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

2019

Communication-Aware Scheduling of Precedence-Constrained Tasks.

Yu Su, Xiaoqi Ren, Shai Vardi, Adam Wierman, Yuxiong He

SIGMETRICS Perform. Evaluation Rev., 2019

LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory.

Reza Yazdani, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González

CoRR, 2019

ZeRO: Memory Optimization Towards Training A Trillion Parameter Models.

Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He

CoRR, 2019

AntMan: Sparse Low-Rank Compression to Accelerate RNN inference.

Samyam Rajbhandari, Harsh Shrivastava, Yuxiong He

CoRR, 2019

Accelerating Large Scale Deep Learning Inference through DeepCPU at Microsoft.

Minjia Zhang, Samyam Rajbhandari, Wenhan Wang, Elton Zheng, Olatunji Ruwase, Jeff Rasley, Jason Li, Junhua Wang, Yuxiong He

Proceedings of the 2019 USENIX Conference on Operational Machine Learning, 2019

Deep Learning Inference Service at Microsoft.

Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, Thomas Liu, Junhua Wang

Proceedings of the 2019 USENIX Conference on Operational Machine Learning, 2019

Fast LSTM Inference by Dynamic Decomposition on Cloud Systems.

Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel

Proceedings of the 2019 IEEE International Conference on Data Mining, 2019

GRNN: Low-Latency and Scalable RNN Inference on GPUs.

Connor Holmes, Daniel Mawhirter, Yuxiong He, Feng Yan, Bo Wu

Proceedings of the Fourteenth EuroSys Conference 2019, Dresden, Germany, March 25-28, 2019, 2019

GRIP: Multi-Store Capacity-Optimized High-Performance Nearest Neighbor Search for Vector Search Engine.

Minjia Zhang, Yuxiong He

Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019

2018

Efficient Deep Neural Network Serving: Fast and Furious.

Feng Yan, Yuxiong He, Olatunji Ruwase, Evgenia Smirni

IEEE Trans. Netw. Serv. Manag., 2018

Stochastic Modeling and Optimization of Stragglers.

Farshid Farhat, Diman Zad Tootaghaj, Yuxiong He, Anand Sivasubramaniam, Mahmut T. Kandemir, Chita R. Das

IEEE Trans. Cloud Comput., 2018

Zoom: SSD-based Vector Search for Optimizing Accuracy, Latency and Memory.

Minjia Zhang, Yuxiong He

CoRR, 2018

Better Caching in Search Advertising Systems with Rapid Refresh Predictions.

Conglong Li, David G. Andersen, Qiang Fu, Sameh Elnikety, Yuxiong He

Proceedings of the 2018 World Wide Web Conference on World Wide Web, 2018

DeepCPU: Serving RNN-based Deep Learning Models 10x Faster.

Minjia Zhang, Samyam Rajbhandari, Wenhan Wang, Yuxiong He

Proceedings of the 2018 USENIX Annual Technical Conference, 2018

Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models.

Minjia Zhang, Wenhan Wang, Xiaodong Liu, Jianfeng Gao, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Learning Intrinsic Sparse Structures within Long Short-Term Memory.

Wei Wen, Yuxiong He, Samyam Rajbhandari, Minjia Zhang, Wenhan Wang, Fang Liu, Bin Hu, Yiran Chen, Hai Li

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

Obtaining and Managing Answer Quality for Online Data-Intensive Services.

Jaimie Kelley, Christopher Stewart, Nathaniel Morris, Devesh Tiwari, Yuxiong He, Sameh Elnikety

ACM Trans. Model. Perform. Evaluation Comput. Syst., 2017

Learning Intrinsic Sparse Structures within Long Short-term Memory.

Wei Wen, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Fang Liu, Bin Hu, Yiran Chen, Hai Li

CoRR, 2017

Optimal Reissue Policies for Reducing Tail Latency.

Tim Kaler, Yuxiong He, Sameh Elnikety

Proceedings of the 29th ACM Symposium on Parallelism in Algorithms and Architectures, 2017

BitFunnel: Revisiting Signatures for Search.

Bob Goodwin, Michael Hopcroft, Dan Luu, Alex Clemmer, Mihaela Curmei, Sameh Elnikety, Yuxiong He

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

HyperDrive: exploring hyperparameters with POP scheduling.

Jeff Rasley, Yuxiong He, Feng Yan, Olatunji Ruwase, Rodrigo Fonseca

Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference, Las Vegas, NV, USA, December 11, 2017

Swayam: distributed autoscaling to meet SLAs of machine learning inference services with resource efficiency.

Arpan Gujarati, Sameh Elnikety, Yuxiong He, Kathryn S. McKinley, Björn B. Brandenburg

Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference, Las Vegas, NV, USA, December 11, 2017

Exploiting heterogeneity for tail latency and energy efficiency.

Md. Enamul Haque, Yuxiong He, Sameh Elnikety, Thu D. Nguyen, Ricardo Bianchini, Kathryn S. McKinley

Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture, 2017

When Good Enough Is Better: Energy-Aware Scheduling for Multicore Servers.

Xinning Hui, Zhihui Du, Jason Liu, Hongyang Sun, Yuxiong He, David A. Bader

Proceedings of the 2017 IEEE International Parallel and Distributed Processing Symposium Workshops, 2017

Workload analysis and caching strategies for search advertising systems.

Conglong Li, David G. Andersen, Qiang Fu, Sameh Elnikety, Yuxiong He

Proceedings of the 2017 Symposium on Cloud Computing, SoCC 2017, Santa Clara, CA, USA, 2017

Optimizing CNNs on Multicores for Scalability, Performance and Goodput.

Samyam Rajbhandari, Yuxiong He, Olatunji Ruwase, Michael Carbin, Trishul M. Chilimbi

Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems, 2017

2016

Prediction and Predictability for Search Query Acceleration.

Seung-won Hwang, Saehoon Kim, Yuxiong He, Sameh Elnikety, Seungjin Choi

ACM Trans. Web, 2016

Venus: Scalable Real-Time Spatial Queries on Microblogs with Adaptive Load Shedding.

Amr Magdy, Mohamed F. Mokbel, Sameh Elnikety, Suman Nath, Yuxiong He

IEEE Trans. Knowl. Data Eng., 2016

SERF: efficient scheduling for fast deep neural network serving via judicious parallelism.

Feng Yan, Yuxiong He, Olatunji Ruwase, Evgenia Smirni

Proceedings of the International Conference for High Performance Computing, 2016

Work stealing for interactive services to meet target latency.

Jing Li, Kunal Agrawal, Sameh Elnikety, Yuxiong He, I-Ting Angelina Lee, Chenyang Lu, Kathryn S. McKinley

Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2016

GeoTrend: spatial trending queries on real-time microblogs.

Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath, Walid G. Aref

Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS 2016, Burlingame, California, USA, October 31, 2016

TPC: Target-Driven Parallelism Combining Prediction and Correction to Reduce Tail Latency in Interactive Services.

Myeongjae Jeon, Yuxiong He, Hwanju Kim, Sameh Elnikety, Scott Rixner, Alan L. Cox

Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems, 2016

2015

Online Resource Management for Carbon-Neutral Cloud Computing.

Kishwar Ahmed, Shaolei Ren, Yuxiong He, Athanasios V. Vasilakos

Proceedings of the Handbook on Data Centers, 2015

Processing and Optimizing Main Memory Spatial-Keyword Queries.

Taesung Lee, Jin-Woo Park, Sanghoon Lee, Seung-won Hwang, Sameh Elnikety, Yuxiong He

Proc. VLDB Endow., 2015

Delayed-Dynamic-Selective (DDS) Prediction for Reducing Extreme Tail Latency in Web Search.

Saehoon Kim, Yuxiong He, Seung-won Hwang, Sameh Elnikety, Seungjin Choi

Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, 2015

Optimal Aggregation Policy for Reducing Tail Latency of Web Search.

Jeong-Min Yun, Yuxiong He, Sameh Elnikety, Shaolei Ren

Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

BATS: Budget-Constrained Autoscaling for Cloud Performance Optimization.

A. Hasan Mahmud, Yuxiong He, Shaolei Ren

Proceedings of the 23rd IEEE International Symposium on Modeling, 2015

Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems.

Feng Yan, Olatunji Ruwase, Yuxiong He, Trishul M. Chilimbi

Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015

Measuring and Managing Answer Quality for Online Data-Intensive Services.

Jaimie Kelley, Christopher Stewart, Nathaniel Morris, Devesh Tiwari, Yuxiong He, Sameh Elnikety

Proceedings of the 2015 IEEE International Conference on Autonomic Computing, 2015

Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services.

Md. Enamul Haque, Yong Hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S. McKinley

Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems, 2015

2014

Energy-efficient multiprocessor scheduling for flow time and makespan.

Hongyang Sun, Yuxiong He, Wen-Jing Hsu, Rui Fan

Theor. Comput. Sci., 2014

Hybrid query execution engine for large attributed graphs.

Sherif Sakr, Sameh Elnikety, Yuxiong He

Inf. Syst., 2014

A Theoretical Foundation for Scheduling and Designing Heterogeneous Processors for Interactive Applications.

Shaolei Ren, Yuxiong He, Kathryn S. McKinley

Proceedings of the Distributed Computing - 28th International Symposium, 2014

Predictive parallelization: taming tail latencies in web search.

Myeongjae Jeon, Saehoon Kim, Seung-won Hwang, Yuxiong He, Sameh Elnikety, Alan L. Cox, Scott Rixner

Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

Mercury: A memory-constrained spatio-temporal real-time search on microblogs.

Amr Magdy, Mohamed F. Mokbel, Sameh Elnikety, Suman Nath, Yuxiong He

Proceedings of the IEEE 30th International Conference on Data Engineering, Chicago, 2014

Mars: Real-time spatio-temporal queries on microblogs.

Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath

Proceedings of the IEEE 30th International Conference on Data Engineering, Chicago, 2014

2013

Horton+: A Distributed System for Processing Declarative Reachability Queries over Partitioned Graphs.

Mohamed Sarwat, Sameh Elnikety, Yuxiong He, Mohamed F. Mokbel

Proc. VLDB Endow., 2013

Solving Graph Isomorphism Using Parameterized Matching.

Juan Mendivelso, Sunghwan Kim, Sameh Elnikety, Yuxiong He, Seung-won Hwang, Yoan J. Pinzón

Proceedings of the String Processing and Information Retrieval, 2013

COCA: online distributed resource management for cost minimization and carbon neutrality in data centers.

Shaolei Ren, Yuxiong He

Proceedings of the International Conference for High Performance Computing, 2013

Energy-Efficient Scheduling for Best-Effort Interactive Services to Achieve High Response Quality.

Zhihui Du, Hongyang Sun, Yuxiong He, Yu He, David A. Bader, Huazhe Zhang

Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing, 2013

Power-effiicent resource allocation in MapReduce clusters.

Kaiqi Xiong, Yuxiong He

Proceedings of the 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013), 2013

Performance Inconsistency in Large Scale Data Processing Clusters.

Mingyuan Xia, Nan Zhu, Sameh Elnikety, Xue Liu, Yuxiong He

Proceedings of the 10th International Conference on Autonomic Computing, 2013

Exploiting Processor Heterogeneity in Interactive Services.

Shaolei Ren, Yuxiong He, Sameh Elnikety, Kathryn S. McKinley

Proceedings of the 10th International Conference on Autonomic Computing, 2013

Adaptive parallelism for web search.

Myeongjae Jeon, Yuxiong He, Sameh Elnikety, Alan L. Cox, Scott Rixner

Proceedings of the Eighth Eurosys Conference 2013, 2013

Topic 3: Scheduling and Load Balancing - (Introduction).

Zhihui Du, Ramin Yahyapour, Yuxiong He, Nectarios Koziris, Bilha Mendelson, Veronika Sonigo, Achim Streit, Andrei Tchernykh

Proceedings of the Euro-Par 2013 Parallel Processing, 2013

QACO: exploiting partial execution in web servers.

Jinhan Kim, Sameh Elnikety, Yuxiong He, Seung-won Hwang, Shaolei Ren

Proceedings of the ACM Cloud and Autonomic Computing Conference, 2013

2012

Horton: Online Query Execution Engine for Large Distributed Graphs.

Mohamed Sarwat, Sameh Elnikety, Yuxiong He, Gabriel Kliot

Proceedings of the IEEE 28th International Conference on Data Engineering (ICDE 2012), 2012

Provably-Efficient Job Scheduling for Energy and Fairness in Geographically Distributed Data Centers.

Shaolei Ren, Yuxiong He, Fei Xu

Proceedings of the 2012 IEEE 32nd International Conference on Distributed Computing Systems, 2012

Budget-based control for interactive services with adaptive execution.

Yuxiong He, Zihao Ye, Qiang Fu, Sameh Elnikety

Proceedings of the 9th International Conference on Autonomic Computing, 2012

Zeta: scheduling interactive services with partial execution.

Yuxiong He, Sameh Elnikety, James R. Larus, Chenyu Yan

Proceedings of the ACM Symposium on Cloud Computing, SOCC '12, 2012

G-SPARQL: a hybrid engine for querying large attributed graphs.

Sherif Sakr, Sameh Elnikety, Yuxiong He

Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 2012

2011

Speed Scaling for Energy and Performance with Instantaneous Parallelism.

Hongyang Sun, Yuxiong He, Wen-Jing Hsu

Proceedings of the Theory and Practice of Algorithms in (Computer) Systems, 2011

Scheduling Functionally Heterogeneous Systems with Utilization Balancing.

Yuxiong He, Jie Liu, Hongyang Sun

Proceedings of the 25th IEEE International Symposium on Parallel and Distributed Processing, 2011

Tians Scheduling: Using Partial Processing in Best-Effort Applications.

Yuxiong He, Sameh Elnikety, Hongyang Sun

Proceedings of the 2011 International Conference on Distributed Computing Systems, 2011

Scheduling for data center interactive services.

Yuxiong He, Sameh Elnikety

Proceedings of the 49th Annual Allerton Conference on Communication, 2011

Position Paper: Embracing Heterogeneity - Improving Energy Efficiency for Interactive Services on Heterogeneous Data Center Hardware.

Yuxiong He, Sameh Elnikety

Proceedings of the AI for Data Center Management and Cloud Computing, 2011

2010

Improved results for scheduling batched parallel jobs by using a generalized analysis framework.

Yuxiong He, Hongyang Sun, Wen-Jing Hsu

J. Parallel Distributed Comput., 2010

Energy-Efficient Multiprocessor Scheduling for Flow Time and Makespan

Hongyang Sun, Yuxiong He, Wen-Jing Hsu

CoRR, 2010

The Cilkview scalability analyzer.

Yuxiong He, Charles E. Leiserson, William M. Leiserson

Proceedings of the SPAA 2010: Proceedings of the 22nd Annual ACM Symposium on Parallelism in Algorithms and Architectures, 2010

2008

Provably Efficient Online Nonclairvoyant Adaptive Scheduling.

Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson

IEEE Trans. Parallel Distributed Syst., 2008

Adaptive work-stealing with parallelism feedback.

Kunal Agrawal, Charles E. Leiserson, Yuxiong He, Wen-Jing Hsu

ACM Trans. Comput. Syst., 2008

2007

Adaptive work stealing with parallelism feedback.

Kunal Agrawal, Yuxiong He, Charles E. Leiserson

Proceedings of the 12th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2007

Provably Efficient Online Non-clairvoyant Adaptive Scheduling.

Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson

Proceedings of the 21th International Parallel and Distributed Processing Symposium (IPDPS 2007), 2007

Adaptive Scheduling with Parallelism Feedback.

Kunal Agrawal, Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson

Proceedings of the 21th International Parallel and Distributed Processing Symposium (IPDPS 2007), 2007

Adaptive Scheduling of Parallel Jobs on Functionally Heterogeneous Resources.

Yuxiong He, Hongyang Sun, Wen-Jing Hsu

Proceedings of the 2007 International Conference on Parallel Processing (ICPP 2007), 2007

2006

Provably Efficient Two-Level Adaptive Scheduling.

Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson

Proceedings of the Job Scheduling Strategies for Parallel Processing, 2006

An Empirical Evaluation ofWork Stealing with Parallelism Feedback.

Kunal Agrawal, Yuxiong He, Charles E. Leiserson

Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (ICDCS 2006), 2006

2004

Secure communications between bandwidth brokers.

Bu-Sung Lee, Wing-Keong Woo, Chai Kiat Yeo, Teck Meng Lim, Bee-Hwa Lim, Yuxiong He, Jie Song

ACM SIGOPS Oper. Syst. Rev., 2004