Shuohang Wang

According to our database, Shuohang Wang authored at least 77 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Knowledge-augmented Methods for Natural Language Processing

Meng Jiang, Bill Yuchen Lin, Shuohang Wang, Yichong Xu, Wenhao Yu, Chenguang Zhu

Springer Briefs in Computer Science, Springer, ISBN: 978-981-97-0749-2, 2024

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy.

Rongzhi Zhang, Kuang Wang, Liyuan Liu, Shuohang Wang, Hao Cheng, Chao Zhang, Yelong Shen

CoRR, 2024

GRIN: GRadient-INformed MoE.

Liyuan Liu, Young Jin Kim, Shuohang Wang, Chen Liang, Yelong Shen, Hao Cheng, Xiaodong Liu, Masahiro Tanaka, Xiaoxia Wu, Wenxiang Hu, Vishrav Chaudhary, Zeqi Lin, Chengruidong Zhang, Jilong Xue, Hany Awadalla, Jianfeng Gao, Weizhu Chen

CoRR, 2024

Cost-Effective Proxy Reward Model Construction with On-Policy and Active Learning.

Yifang Chen, Shuohang Wang, Ziyi Yang, Hiteshi Sharma, Nikos Karampatziakis, Donghan Yu, Kevin G. Jamieson, Simon Shaolei Du, Yelong Shen

CoRR, 2024

Self-Exploring Language Models: Active Preference Elicitation for Online Alignment.

Shenao Zhang, Donghan Yu, Hiteshi Sharma, Ziyi Yang, Shuohang Wang, Hany Hassan, Zhaoran Wang

CoRR, 2024

Multi-LoRA Composition for Image Generation.

Ming Zhong, Yelong Shen, Shuohang Wang, Yadong Lu, Yizhu Jiao, Siru Ouyang, Donghan Yu, Jiawei Han, Weizhu Chen

CoRR, 2024

SciAgent: Tool-augmented Language Models for Scientific Reasoning.

Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun, Hany Hassan Awadalla, Weizhu Chen

CoRR, 2024

Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation.

Siru Ouyang, Shuohang Wang, Minhao Jiang, Ming Zhong, Donghan Yu, Jiawei Han, Yelong Shen

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

SciAgent: Tool-augmented Language Models for Scientific Reasoning.

Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents.

Simeng Sun, Yang Liu, Shuohang Wang, Dan Iter, Chenguang Zhu, Mohit Iyyer

Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, 2024

Small Models are Valuable Plug-ins for Large Language Models.

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian J. McAuley

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions.

Siru Ouyang, Shuohang Wang, Yang Liu, Ming Zhong, Yizhu Jiao, Dan Iter, Reid Pryzant, Chenguang Zhu, Heng Ji, Jiawei Han

CoRR, 2023

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents.

Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer

CoRR, 2023

LMGQS: A Large-scale Dataset for Query-focused Summarization.

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

CoRR, 2023

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment.

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu

CoRR, 2023

Sparse Modular Activation for Efficient Sequence Modeling.

Liliang Ren, Yang Liu, Shuohang Wang, Yichong Xu, Chenguang Zhu, ChengXiang Zhai

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Prompting GPT-3 To Be Reliable.

Chenglei Si, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan L. Boyd-Graber, Lijuan Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Generate rather than Retrieve: Large Language Models are Strong Context Generators.

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models.

Zhihan Zhang, Shuohang Wang, Wenhao Yu, Yichong Xu, Dan Iter, Qingkai Zeng, Yang Liu, Chenguang Zhu, Meng Jiang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT.

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

LMGQS: A Large-scale Dataset for Query-focused Summarization.

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions.

Siru Ouyang, Shuohang Wang, Yang Liu, Ming Zhong, Yizhu Jiao, Dan Iter, Reid Pryzant, Chenguang Zhu, Heng Ji, Jiawei Han

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment.

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

In-Context Demonstration Selection with Cross Entropy Difference.

Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning.

Soumya Sanyal, Yichong Xu, Shuohang Wang, Ziyi Yang, Reid Pryzant, Wenhao Yu, Chenguang Zhu, Xiang Ren

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Empowering Language Models with Knowledge Graph Reasoning for Question Answering.

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

CoRR, 2022

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners.

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention.

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation.

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering.

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach.

Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Task Compass: Scaling Multi-task Pre-training with Task Prefix.

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

AdaPrompt: Adaptive Model Training for Prompt-based NLP.

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

CLIP-Event: Connecting Text and Images with Event Structures.

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

An Empirical Study of Training End-to-End Vision-and-Language Transformers.

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, Zicheng Liu, Michael Zeng

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering.

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data.

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Leveraging Knowledge in Multilingual Commonsense Reasoning.

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

Dict-BERT: Enhancing Language Model Pre-training with Dictionary.

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

Playing Lottery Tickets with Vision and Language.

Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

MLP Architectures for Vision-and-Language Modeling: An Empirical Study.

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

CoRR, 2021

Playing Lottery Tickets with Vision and Language.

Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu

CoRR, 2021

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models.

Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Hassan Awadallah, Bo Li

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

The Elastic Lottery Ticket Hypothesis.

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval.

Siqi Sun, Yen-Chun Chen, Linjie Li, Shuohang Wang, Yuwei Fang, Jingjing Liu

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective.

Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu

Proceedings of the 9th International Conference on Learning Representations, 2021

NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset.

Qiyuan Zhang, Lei Wang, Sicheng Yu, Shuohang Wang, Yang Wang, Jing Jiang, Ee-Peng Lim

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Want To Reduce Labeling Cost? GPT-3 Can Help.

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training.

Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu, Jingjing Liu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

On Orthogonality Constraints for Transformers.

Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Cluster-Former: Clustering-based Sparse Transformer for Question Answering.

Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets.

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding.

Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Counterfactual Variable Control for Robust and Interpretable Question Answering.

Sicheng Yu, Yulei Niu, Shuohang Wang, Jing Jiang, Qianru Sun

CoRR, 2020

Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding.

Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu

CoRR, 2020

Accelerating Real-Time Question Answering via Question Generation.

Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu

CoRR, 2020

T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack.

Boxin Wang, Hengzhi Pei, Boyuan Pan, Qian Chen, Shuohang Wang, Bo Li

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Cross-Thought for Sentence Encoder Pre-training.

Shuohang Wang, Yuwei Fang, Siqi Sun, Zhe Gan, Yu Cheng, Jingjing Liu, Jing Jiang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Contrastive Distillation on Intermediate Representations for Language Model Compression.

Siqi Sun, Zhe Gan, Yuwei Fang, Yu Cheng, Shuohang Wang, Jingjing Liu

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Hierarchical Graph Network for Multi-hop Question Answering.

Yuwei Fang, Siqi Sun, Zhe Gan, Rohit Pillai, Shuohang Wang, Jingjing Liu

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Multi-Fact Correction in Abstractive Text Summarization.

Yue Dong, Shuohang Wang, Zhe Gan, Yu Cheng, Jackie Chi Kit Cheung, Jingjing Liu

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Multi-Level Head-Wise Match and Aggregation in Transformer for Textual Sequence Matching.

Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, Jingjing Liu

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Knowledge Base Question Answering With a Matching-Aggregation Model and Question-Specific Contextual Relations.

Yunshi Lan, Shuohang Wang, Jing Jiang

IEEE ACM Trans. Audio Speech Lang. Process., 2019

What does BERT Learn from Multiple-Choice Reading Comprehension Datasets?

Chenglei Si, Shuohang Wang, Min-Yen Kan, Jing Jiang

CoRR, 2019

Compositional De-Attention Networks.

Yi Tay, Anh Tuan Luu, Aston Zhang, Shuohang Wang, Siu Cheung Hui

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Unsupervised Deep Structured Semantic Models for Commonsense Reasoning.

Shuohang Wang, Sheng Zhang, Yelong Shen, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, Jing Jiang

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Knowledge Base Question Answering with Topic Units.

Yunshi Lan, Shuohang Wang, Jing Jiang

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, 2019

Multi-hop Knowledge Base Question Answering with an Iterative Sequence Matching Model.

Yunshi Lan, Shuohang Wang, Jing Jiang

Proceedings of the 2019 IEEE International Conference on Data Mining, 2019

Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks.

Yi Tay, Aston Zhang, Anh Tuan Luu, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, Siu Cheung Hui

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives.

Yi Tay, Shuohang Wang, Anh Tuan Luu, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering.

Shuohang Wang, Mo Yu, Jing Jiang, Wei Zhang, Xiaoxiao Guo, Shiyu Chang, Zhiguo Wang, Tim Klinger, Gerald Tesauro, Murray Campbell

Proceedings of the 6th International Conference on Learning Representations, 2018

A Co-Matching Model for Multi-choice Reading Comprehension.

Shuohang Wang, Mo Yu, Jing Jiang, Shiyu Chang

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

R³: Reinforced Ranker-Reader for Open-Domain Question Answering.

Shuohang Wang, Mo Yu, Xiaoxiao Guo, Zhiguo Wang, Tim Klinger, Wei Zhang, Shiyu Chang, Gerry Tesauro, Bowen Zhou, Jing Jiang

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

2017

R³: Reinforced Reader-Ranker for Open-Domain Question Answering.

Shuohang Wang, Mo Yu, Xiaoxiao Guo, Zhiguo Wang, Tim Klinger, Wei Zhang, Shiyu Chang, Gerald Tesauro, Bowen Zhou, Jing Jiang

CoRR, 2017

Machine Comprehension Using Match-LSTM and Answer Pointer.

Shuohang Wang, Jing Jiang

Proceedings of the 5th International Conference on Learning Representations, 2017

A Compare-Aggregate Model for Matching Text Sequences.

Shuohang Wang, Jing Jiang

Proceedings of the 5th International Conference on Learning Representations, 2017

2016

Learning Natural Language Inference with LSTM.

Shuohang Wang, Jing Jiang

Proceedings of the NAACL HLT 2016, 2016