Wei Zhang

According to our database, Wei Zhang authored at least 46 papers between 2005 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Activity-weight duality in feed-forward neural networks reveals two co-determinants for generalization.

Yu Feng, Wei Zhang, Yuhai Tu

Nat. Mac. Intell., August, 2023

Soft Random Sampling: A Theoretical and Empirical Analysis.

Xiaodong Cui, Ashish R. Mittal, Songtao Lu, Wei Zhang, George Saon, Brian Kingsbury

CoRR, 2023

2022

Robustness to Unbounded Smoothness of Generalized SignSGD.

Michael Crawshaw, Mingrui Liu, Francesco Orabona, Wei Zhang, Zhenxun Zhuang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Asynchronous Decentralized Distributed Training of Acoustic Models.

Xiaodong Cui, Wei Zhang, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung

IEEE ACM Trans. Audio Speech Lang. Process., 2021

Loss Landscape Dependent Self-Adjusting Learning Rates in Decentralized Stochastic Gradient Descent.

Wei Zhang, Mingrui Liu, Yu Feng, Xiaodong Cui, Brian Kingsbury, Yuhai Tu

CoRR, 2021

Project CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks.

Ruchir Puri, David S. Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Julian Dolby, Jie Chen, Mihir R. Choudhury, Lindsey Decker, Veronika Thost, Luca Buratti, Saurabh Pujar, Ulrich Finkler

CoRR, 2021

CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks.

Ruchir Puri, David S. Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Julian Dolby, Jie Chen, Mihir R. Choudhury, Lindsey Decker, Veronika Thost, Luca Buratti, Saurabh Pujar, Shyam Ramji, Ulrich Finkler, Susan Malaika, Frederick Reiss

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

4-Bit Quantization of LSTM-Based Speech Recognition Models.

Andrea Fasoli, Chia-Yu Chen, Mauricio J. Serrano, Xiao Sun, Naigang Wang, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian Kingsbury, Wei Zhang, Zoltán Tüske, Kailash Gopalakrishnan

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

2020

Distributed Training of Deep Neural Network Acoustic Models for Automatic Speech Recognition: A comparison of current training strategies.

Xiaodong Cui, Wei Zhang, Ulrich Finkler, George Saon, Michael Picheny, David S. Kung

IEEE Signal Process. Mag., 2020

Change Detection from Remote Sensing to Guide OpenStreetMap Labeling.

Conrad M. Albrecht, Rui Zhang, Xiaodong Cui, Marcus Freitag, Hendrik F. Hamann, Levente J. Klein, Ulrich Finkler, Fernando J. Marianno, Johannes Schmude, Norman Bobroff, Wei Zhang, Carlo Siebenschuh, Siyuan Lu

ISPRS Int. J. Geo Inf., 2020

Adam⁺: A Stochastic Method with Adaptive Variance Reduction.

Mingrui Liu, Wei Zhang, Francesco Orabona, Tianbao Yang

CoRR, 2020

Distributed Training of Deep Neural Network Acoustic Models for Automatic Speech Recognition.

Xiaodong Cui, Wei Zhang, Ulrich Finkler, George Saon, Michael Picheny, David S. Kung

CoRR, 2020

A Decentralized Parallel Algorithm for Training Generative Adversarial Nets.

Mingrui Liu, Wei Zhang, Youssef Mroueh, Xiaodong Cui, Jarret Ross, Tianbao Yang, Payel Das

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training.

Chia-Yu Chen, Jiamin Ni, Songtao Lu, Xiaodong Cui, Pin-Yu Chen, Xiao Sun, Naigang Wang, Swagath Venkataramani, Vijayalakshmi Srinivasan, Wei Zhang, Kailash Gopalakrishnan

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Map Generation from Large Scale Incomplete and Inaccurate Data Labels.

Rui Zhang, Conrad M. Albrecht, Wei Zhang, Xiaodong Cui, Ulrich Finkler, David S. Kung, Siyuan Lu

Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets.

Mingrui Liu, Youssef Mroueh, Jerret Ross, Wei Zhang, Xiaodong Cui, Payel Das, Tianbao Yang

Proceedings of the 8th International Conference on Learning Representations, 2020

Improving Efficiency in Large-Scale Decentralized Distributed Training.

Wei Zhang, Xiaodong Cui, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, Youssef Mroueh, Alper Buyuktosunoglu, Payel Das, David S. Kung, Michael Picheny

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

Decentralized Parallel Algorithm for Training Generative Adversarial Nets.

Mingrui Liu, Youssef Mroueh, Wei Zhang, Xiaodong Cui, Jerret Ross, Tianbao Yang, Payel Das

CoRR, 2019

Hybrid 8-bit Floating Point (HFP8) Training and Inference for Deep Neural Networks.

Xiao Sun, Jungwook Choi, Chia-Yu Chen, Naigang Wang, Swagath Venkataramani, Vijayalakshmi Srinivasan, Xiaodong Cui, Wei Zhang, Kailash Gopalakrishnan

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

A Highly Efficient Distributed Deep Learning System for Automatic Speech Recognition.

Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David S. Kung, Michael Picheny

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Large-Scale Mixed-Bandwidth Deep Neural Network Acoustic Modeling for Automatic Speech Recognition.

Khoi-Nguyen C. Mac, Xiaodong Cui, Wei Zhang, Michael Picheny

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Distributed Deep Learning Strategies for Automatic Speech Recognition.

Wei Zhang, Xiaodong Cui, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung, Michael Picheny

Proceedings of the IEEE International Conference on Acoustics, 2019

2018

Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks.

Xiaodong Cui, Wei Zhang, Zoltán Tüske, Michael Picheny

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Asynchronous Decentralized Parallel Stochastic Gradient Descent.

Xiangru Lian, Wei Zhang, Ce Zhang, Ji Liu

Proceedings of the 35th International Conference on Machine Learning, 2018

Forecast of Solar Energy Production - A Deep Learning Approach.

Rui Zhang, Minwei Feng, Wei Zhang, Siyuan Lu, Fei Wang

Proceedings of the 2018 IEEE International Conference on Big Knowledge, 2018

2017

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent.

Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, Ji Liu

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Model Accuracy and Runtime Tradeoff in Distributed Deep Learning: A Systematic Study.

Suyog Gupta, Wei Zhang, Fei Wang

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017

Accelerator Design for Deep Learning Training: Extended Abstract: Invited.

Ankur Agrawal, Chia-Yu Chen, Jungwook Choi, Kailash Gopalakrishnan, Jinwook Oh, Sunil Shukla, Viji Srinivasan, Swagath Venkataramani, Wei Zhang

Proceedings of the 54th Annual Design Automation Conference, 2017

2016

X10 and APGAS at Petascale.

Olivier Tardieu, Benjamin Herta, David Cunningham, David Grove, Prabhanjan Kambadur, Vijay A. Saraswat, Avraham Shinnar, Mikio Takeuchi, Mandana Vaziri, Wei Zhang

ACM Trans. Parallel Comput., 2016

META: Middleware for Events, Transactions, and Analytics.

Matthew Arnold, David Grove, Benjamin Herta, Michael Hind, Martin Hirzel, Arun Iyengar, Louis Mandel, Vijay A. Saraswat, Avraham Shinnar, Jérôme Siméon, Mikio Takeuchi, Olivier Tardieu, Wei Zhang

IBM J. Res. Dev., 2016

Staleness-Aware Async-SGD for Distributed Deep Learning.

Wei Zhang, Suyog Gupta, Xiangru Lian, Ji Liu

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

AQuA: adaptive quality analytics.

Wei Zhang, Martin Hirzel, David Grove

Proceedings of the 10th ACM International Conference on Distributed and Event-based Systems, 2016

2015

Model Accuracy and Runtime Tradeoff in Distributed Deep Learning.

Suyog Gupta, Wei Zhang, Josh Milthorpe

CoRR, 2015

Fixing, preventing, and recovering from concurrency bugs.

Dongdong Deng, Guoliang Jin, Marc de Kruijf, Ang Li, Ben Liblit, Shan Lu, Shanxiang Qi, Jinglei Ren, Karthikeyan Sankaralingam, Linhai Song, Yongwei Wu, Mingxing Zhang, Wei Zhang, Weimin Zheng

Sci. China Inf. Sci., 2015

2014

GLB: lifeline-based global load balancing library in x10.

Wei Zhang, Olivier Tardieu, David Grove, Benjamin Herta, Tomio Kamada, Vijay A. Saraswat, Mikio Takeuchi

Proceedings of the first workshop on Parallel programming for analytics applications, 2014

2013

ConMem: Detecting Crash-Triggering Concurrency Bugs through an Effect-Oriented Approach.

Wei Zhang, Chong Sun, Junghee Lim, Shan Lu, Thomas W. Reps

ACM Trans. Softw. Eng. Methodol., 2013

Efficient concurrency-bug detection across inputs.

Dongdong Deng, Wei Zhang, Shan Lu

Proceedings of the 2013 ACM SIGPLAN International Conference on Object Oriented Programming Systems Languages & Applications, 2013

ConAir: featherweight concurrency bug recovery via single-threaded idempotent execution.

Wei Zhang, Marc de Kruijf, Ang Li, Shan Lu, Karthikeyan Sankaralingam

Proceedings of the Architectural Support for Programming Languages and Operating Systems, 2013

2012

Automated Concurrency-Bug Fixing.

Guoliang Jin, Wei Zhang, Dongdong Deng

Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, 2012

Understanding the Interleaving-Space Overlap across Inputs and Software Versions.

Dongdong Deng, Wei Zhang, Borui Wang, Peisen Zhao, Shan Lu

Proceedings of the 4th USENIX Workshop on Hot Topics in Parallelism, 2012

2011

Automated atomicity-violation fixing.

Guoliang Jin, Linhai Song, Wei Zhang, Shan Lu, Ben Liblit

Proceedings of the 32nd ACM SIGPLAN Conference on Programming Language Design and Implementation, 2011

ConSeq: detecting concurrency bugs through sequential errors.

Wei Zhang, Junghee Lim, Ramya Olichandran, Joel Scherpelz, Guoliang Jin, Shan Lu, Thomas W. Reps

Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems, 2011

2010

Applying scalable phonetic context similarity in unit selection of concatenative text-to-speech.

Wei Zhang, Xiaodong Cui

Proceedings of the 11th Annual Conference of the International Speech Communication Association, 2010

ConMem: detecting severe concurrency bugs through an effect-oriented approach.

Wei Zhang, Chong Sun, Shan Lu

Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems, 2010

2008

Developing high performance asr in the IBM multilingual speech-to-speech translation system.

Xiaodong Cui, Liang Gu, Bing Xiang, Wei Zhang, Yuqing Gao

Proceedings of the IEEE International Conference on Acoustics, 2008

2005

Toward multiple-language TTS: experiments in English and Mandarin.

Raul Fernandez, Wei Zhang, Ellen Eide, Raimo Bakis, Wael Hamza, Yi Liu, Michael Picheny, John F. Pitrelli, Yong Qing, Zhiwei Shuang, Li Qin Shen

Proceedings of the 9th European Conference on Speech Communication and Technology, 2005