Weizhu Chen

According to our database, Weizhu Chen authored at least 158 papers between 2007 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning.

Yaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Denvy Deng, Feng Sun, Qi Zhang, Weizhu Chen, Yunhai Tong

CoRR, 2024

GRIN: GRadient-INformed MoE.

Liyuan Liu, Young Jin Kim, Shuohang Wang, Chen Liang, Yelong Shen, Hao Cheng, Xiaodong Liu, Masahiro Tanaka, Xiaoxia Wu, Wenxiang Hu, Vishrav Chaudhary, Zeqi Lin, Chengruidong Zhang, Jilong Xue, Hany Awadalla, Jianfeng Gao, Weizhu Chen

CoRR, 2024

Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arena.

Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Qingwei Lin, Jianguang Lou, Shifeng Chen, Yansong Tang, Weizhu Chen

CoRR, 2024

Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling.

Liliang Ren, Yang Liu, Yadong Lu, Yelong Shen, Chen Liang, Weizhu Chen

CoRR, 2024

Self-Augmented Preference Optimization: Off-Policy Paradigms for Language Model Alignment.

Yueqin Yin, Zhendong Wang, Yujia Xie, Weizhu Chen, Mingyuan Zhou

CoRR, 2024

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou

CoRR, 2024

Rho-1: Not All Tokens Are What You Need.

Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen

CoRR, 2024

A Note on LoRA.

Vlad Fomenko, Han Yu, Jongho Lee, Stanley Hsieh, Weizhu Chen

CoRR, 2024

Exploring the Mystery of Influential Data for Mathematical Reasoning.

Xinzhe Ni, Yeyun Gong, Zhibin Gou, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen

CoRR, 2024

Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning.

Yiming Huang, Xiao Liu, Yeyun Gong, Zhibin Gou, Yelong Shen, Nan Duan, Weizhu Chen

CoRR, 2024

Multi-LoRA Composition for Image Generation.

Ming Zhong, Yelong Shen, Shuohang Wang, Yadong Lu, Yizhu Jiao, Siru Ouyang, Donghan Yu, Jiawei Han, Weizhu Chen

CoRR, 2024

SciAgent: Tool-augmented Language Models for Scientific Reasoning.

Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun, Hany Hassan Awadalla, Weizhu Chen

CoRR, 2024

Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts.

Yueqin Yin, Zhendong Wang, Yi Gu, Hai Huang, Weizhu Chen, Mingyuan Zhou

CoRR, 2024

AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models.

Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen, Nan Duan

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators.

Xingwei He, Zhenghao Lin, Yeyun Gong, A-Long Jin, Hang Zhang, Chen Lin, Jian Jiao, Siu Ming Yiu, Nan Duan, Weizhu Chen

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track, 2024

Language Models can be Deductive Solvers.

Jiazhan Feng, Ruochen Xu, Junheng Hao, Hiteshi Sharma, Yelong Shen, Dongyan Zhao, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

Supervised Knowledge Makes Large Language Models Better In-context Learners.

Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Wei Ye, Xing Xie, Weizhu Chen, Yue Zhang

Proceedings of the Twelfth International Conference on Learning Representations, 2024

LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models.

Yixiao Li, Yifan Yu, Chen Liang, Nikos Karampatziakis, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the Twelfth International Conference on Learning Representations, 2024

ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving.

Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen

Proceedings of the Twelfth International Conference on Learning Representations, 2024

CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing.

Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective.

Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Automatic Instruction Evolving for Large Language Models.

Weihao Zeng, Can Xu, Yingxiu Zhao, Jian-Guang Lou, Weizhu Chen

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Can LLMs Learn From Mistakes? An Empirical Study on Reasoning Tasks.

Shengnan An, Zexiong Ma, Siqi Cai, Zeqi Lin, Nanning Zheng, Jian-Guang Lou, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Competition-Level Problems are Effective LLM Evaluators.

Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Shuai Lu, Fangyu Lei, Yaobo Liang, Yelong Shen, Chen Lin, Nan Duan, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Language Models can be Logical Solvers.

Jiazhan Feng, Ruochen Xu, Junheng Hao, Hiteshi Sharma, Yelong Shen, Dongyan Zhao, Weizhu Chen

CoRR, 2023

Learning From Mistakes Makes LLM Better Reasoner.

Shengnan An, Zexiong Ma, Zeqi Lin, Nanning Zheng, Jian-Guang Lou, Weizhu Chen

CoRR, 2023

Sparse Backpropagation for MoE Training.

Liyuan Liu, Jianfeng Gao, Weizhu Chen

CoRR, 2023

Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistency.

Baizhou Huang, Shuai Lu, Weizhu Chen, Xiaojun Wan, Nan Duan

CoRR, 2023

Deep Reinforcement Learning from Hierarchical Weak Preference Feedback.

Alexander Bukharin, Yixiao Li, Pengcheng He, Weizhu Chen, Tuo Zhao

CoRR, 2023

GRILL: Grounded Vision-language Pre-training via Aligning Text and Image Regions.

Woojeong Jin, Subhabrata Mukherjee, Yu Cheng, Yelong Shen, Weizhu Chen, Ahmed Hassan Awadallah, Damien Jose, Xiang Ren

CoRR, 2023

RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

Fengji Zhang, Bei Chen, Yue Zhang, Jin Liu, Daoguang Zan, Yi Mao, Jian-Guang Lou, Weizhu Chen

CoRR, 2023

Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback.

Baolin Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao

CoRR, 2023

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation.

Tong Wu, Zhihao Fan, Xiao Liu, Hai-Tao Zheng, Yeyun Gong, Yelong Shen, Jian Jiao, Juntao Li, Zhongyu Wei, Jian Guo, Nan Duan, Weizhu Chen

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models.

Zhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang, Pengcheng He, Zhangyang Wang, Weizhu Chen, Mingyuan Zhou

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

In-Context Learning Unlocked for Diffusion Models.

Zhendong Wang, Yifan Jiang, Yadong Lu, Yelong Shen, Pengcheng He, Weizhu Chen, Zhangyang (Atlas) Wang, Mingyuan Zhou

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Meet in the Middle: A New Pre-training Paradigm.

Anh Nguyen, Nikos Karampatziakis, Weizhu Chen

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models.

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

Proceedings of the International Conference on Machine Learning, 2023

HyperTuning: Toward Adapting Large Language Models without Back-propagation.

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

Proceedings of the International Conference on Machine Learning, 2023

Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise.

Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen

Proceedings of the International Conference on Machine Learning, 2023

Less is More: Task-aware Layer-wise Distillation for Language Model Compression.

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning.

Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Diffusion-GAN: Training GANs with Diffusion.

Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Eleventh International Conference on Learning Representations, 2023

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing.

Pengcheng He, Jianfeng Gao, Weizhu Chen

Proceedings of the Eleventh International Conference on Learning Representations, 2023

CodeT: Code Generation with Generated Tests.

Bei Chen, Fengji Zhang, Anh Nguyen, Daoguang Zan, Zeqi Lin, Jian-Guang Lou, Weizhu Chen

Proceedings of the Eleventh International Conference on Learning Representations, 2023

RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

Fengji Zhang, Bei Chen, Yue Zhang, Jacky Keung, Jin Liu, Daoguang Zan, Yi Mao, Jian-Guang Lou, Weizhu Chen

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy.

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Skill-Based Few-Shot Selection for In-Context Learning.

Shengnan An, Bo Zhou, Zeqi Lin, Qiang Fu, Bei Chen, Nanning Zheng, Weizhu Chen, Jian-Guang Lou

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Joint Generator-Ranker Learning for Natural Language Generation.

Weizhou Shen, Yeyun Gong, Yelong Shen, Song Wang, Xiaojun Quan, Nan Duan, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Code Execution with Pre-trained Language Models.

Chenxiao Liu, Shuai Lu, Weizhu Chen, Daxin Jiang, Alexey Svyatkovskiy, Shengyu Fu, Neel Sundaresan, Nan Duan

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Making Language Models Better Reasoners with Step-Aware Verifier.

Yifei Li, Zeqi Lin, Shizhuo Zhang, Qiang Fu, Bei Chen, Jian-Guang Lou, Weizhu Chen

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models.

Xuxi Chen, Tianlong Chen, Weizhu Chen, Ahmed Hassan Awadallah, Zhangyang Wang, Yu Cheng

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

GENIE: Large Scale Pre-training for Text Generation with Diffusion Model.

Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Weizhu Chen, Nan Duan

CoRR, 2022

Generation-Augmented Query Expansion For Code Retrieval.

Dong Li, Yelong Shen, Ruoming Jin, Yi Mao, Kuan Wang, Weizhu Chen

CoRR, 2022

GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation.

Biyang Guo, Yeyun Gong, Yelong Shen, Songqiao Han, Hailiang Huang, Nan Duan, Weizhu Chen

CoRR, 2022

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval.

Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen

CoRR, 2022

On the Advance of Making Language Models Better Reasoners.

Yifei Li, Zeqi Lin, Shizhuo Zhang, Qiang Fu, Bei Chen, Jian-Guang Lou, Weizhu Chen

CoRR, 2022

A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation.

Weizhen Qi, Yeyun Gong, Yelong Shen, Jian Jiao, Yu Yan, Houqiang Li, Ruofei Zhang, Weizhu Chen, Nan Duan

CoRR, 2022

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer.

Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki, Weizhu Chen, Jianfeng Gao

CoRR, 2022

Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models.

Shengnan An, Yifei Li, Zeqi Lin, Qian Liu, Bei Chen, Qiang Fu, Weizhu Chen, Nanning Zheng, Jian-Guang Lou

CoRR, 2022

Truncated Diffusion Probabilistic Models.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

CoRR, 2022

Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

CoRR, 2022

CodeRetriever: Unimodal and Bimodal Contrastive Learning.

Xiaonan Li, Yeyun Gong, Yelong Shen, Xipeng Qiu, Hang Zhang, Bolun Yao, Weizhen Qi, Daxin Jiang, Weizhu Chen, Nan Duan

CoRR, 2022

Virtual information core optimization for collaborative filtering recommendation based on clustering and evolutionary algorithms.

Caihong Mu, Weizhu Chen, Yi Liu, Dongchang Lei, Ruochen Liu

Appl. Soft Comput., 2022

MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.

Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

ALLSH: Active Learning Guided by Local Sensitivity and Hardness.

Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022

OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering.

Zhengbao Jiang, Yi Mao, Pengcheng He, Graham Neubig, Weizhu Chen

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

CERT: Continual Pre-training on Sketches for Library-oriented Code Generation.

Daoguang Zan, Bei Chen, Dejian Yang, Zeqi Lin, Minsu Kim, Bei Guan, Yongji Wang, Weizhu Chen, Jian-Guang Lou

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.

Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2022

Adversarial Retriever-Ranker for Dense Text Retrieval.

Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen

Proceedings of the Tenth International Conference on Learning Representations, 2022

TAPEX: Table Pre-training via Learning a Neural SQL Executor.

Qian Liu, Bei Chen, Jiaqi Guo, Morteza Ziyadi, Zeqi Lin, Weizhu Chen, Jian-Guang Lou

Proceedings of the Tenth International Conference on Learning Representations, 2022

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models.

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the Tenth International Conference on Learning Representations, 2022

LoRA: Low-Rank Adaptation of Large Language Models.

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

Proceedings of the Tenth International Conference on Learning Representations, 2022

Reasoning Like Program Executors.

Xinyu Pi, Qian Liu, Bei Chen, Morteza Ziyadi, Zeqi Lin, Qiang Fu, Yan Gao, Jian-Guang Lou, Weizhu Chen

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search.

Xiaonan Li, Yeyun Gong, Yelong Shen, Xipeng Qiu, Hang Zhang, Bolun Yao, Weizhen Qi, Daxin Jiang, Weizhu Chen, Nan Duan

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation.

Xiaonan Li, Daya Guo, Yeyun Gong, Yun Lin, Yelong Shen, Xipeng Qiu, Daxin Jiang, Weizhu Chen, Nan Duan

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Scalable Learning to Optimize: A Learned Optimizer Can Train Big Models.

Xuxi Chen, Tianlong Chen, Yu Cheng, Weizhu Chen, Ahmed Awadallah, Zhangyang Wang

Proceedings of the Computer Vision - ECCV 2022, 2022

Controllable Natural Language Generation with Contrastive Prefixes.

Jing Qian, Li Dong, Yelong Shen, Furu Wei, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation.

Tianyu Liu, Yizhe Zhang, Chris Brockett, Yi Mao, Zhifang Sui, Weizhu Chen, Bill Dolan

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing.

Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models.

Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Finding the Dominant Winning Ticket in Pre-Trained Language Models.

Zhuocheng Gong, Di He, Yelong Shen, Tie-Yan Liu, Weizhu Chen, Dongyan Zhao, Ji-Rong Wen, Rui Yan

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation.

Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

What Makes Good In-Context Examples for GPT-3?

Jiachang Liu, Dinghan Shen, Yizhe Zhang, Bill Dolan, Lawrence Carin, Weizhu Chen

Proceedings of Deep Learning Inside Out: The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, 2022

XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge.

Xiaoze Jiang, Yaobo Liang, Weizhu Chen, Nan Duan

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

LoRA: Low-Rank Adaptation of Large Language Models.

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Weizhu Chen

CoRR, 2021

HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalization.

Jiaao Chen, Dinghan Shen, Weizhu Chen, Diyi Yang

CoRR, 2021

Adversarial Training as Stackelberg Game: An Unrolled Optimization Approach.

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

CoRR, 2021

Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer.

Ge Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki, Weizhu Chen, Jianfeng Gao

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Contextual Bandit Applications in a Customer Support Bot.

Sandra Sajeev, Jade Huang, Nikos Karampatziakis, Matthew Hall, Sebastian Kochman, Weizhu Chen

Proceedings of the KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2021

Poolingformer: Long Document Modeling with Pooling Attention.

Hang Zhang, Yeyun Gong, Yelong Shen, Weisheng Li, Jiancheng Lv, Nan Duan, Weizhu Chen

Proceedings of the 38th International Conference on Machine Learning, 2021

BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining.

Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Weizhu Chen, Dayiheng Liu, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, Ming Zhou, Nan Duan

Proceedings of the 38th International Conference on Machine Learning, 2021

CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding.

Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Weizhu Chen, Jiawei Han

Proceedings of the 9th International Conference on Learning Representations, 2021

MixKD: Towards Efficient Distillation of Large-scale Language Models.

Kevin J. Liang, Weituo Hao, Dinghan Shen, Yufan Zhou, Weizhu Chen, Changyou Chen, Lawrence Carin

Proceedings of the 9th International Conference on Learning Representations, 2021

Deberta: decoding-Enhanced Bert with Disentangled Attention.

Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen

Proceedings of the 9th International Conference on Learning Representations, 2021

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach.

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

ARCH: Efficient Adversarial Regularized Training with Caching.

Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Token-wise Curriculum Learning for Neural Machine Translation.

Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Finetuning Pretrained Transformers into RNNs.

Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Few-Shot Named Entity Recognition: An Empirical Baseline Study.

Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Memory-Efficient Differentiable Transformer Architecture Search.

Yuekai Zhao, Li Dong, Yelong Shen, Zhihua Zhang, Furu Wei, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Reader-Guided Passage Reranking for Open-Domain Question Answering.

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Generation-Augmented Retrieval for Open-Domain Question Answering.

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

GLGE: A New General Language Generation Evaluation Benchmark.

Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization.

Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizability.

Jiaao Chen, Dinghan Shen, Weizhu Chen, Diyi Yang

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

UnitedQA: A Hybrid Approach for Open Domain Question Answering.

Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Few-Shot Named Entity Recognition: A Comprehensive Study.

Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han

CoRR, 2020

Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model.

Mingzhi Zheng, Dinghan Shen, Yelong Shen, Weizhu Chen, Lin Xiao

CoRR, 2020

A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation.

Dinghan Shen, Mingzhi Zheng, Yelong Shen, Yanru Qu, Weizhu Chen

CoRR, 2020

Example-Based Named Entity Recognition.

Morteza Ziyadi, Yuting Sun, Abhishek Goswami, Jade Huang, Weizhu Chen

CoRR, 2020

Adversarial Training for Large Neural Language Models.

Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

CoRR, 2020

Conditional Self-Attention for Query-based Summarization.

Yujia Xie, Tianyi Zhou, Yi Mao, Weizhu Chen

CoRR, 2020

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned.

Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih

Proceedings of the NeurIPS 2020 Competition and Demonstration Track, 2020

On the Variance of the Adaptive Learning Rate and Beyond.

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Proceedings of the 8th International Conference on Learning Representations, 2020

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning.

Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Understanding the Difficulty of Training Transformers.

Liyuan Liu, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Jiawei Han

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding.

Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2020

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization.

Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization.

Lin Xiao, Adams Wei Yu, Qihang Lin, Weizhu Chen

J. Mach. Learn. Res., 2019

X-SQL: reinforce schema representation with context.

Pengcheng He, Yi Mao, Kaushik Chakrabarti, Weizhu Chen

CoRR, 2019

A Hybrid Neural Network Model for Commonsense Reasoning.

Pengcheng He, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

CoRR, 2019

Lessons from Real-World Reinforcement Learning in a Customer Support Bot.

Nikos Karampatziakis, Sebastian Kochman, Jade Huang, Paul Mineiro, Kathy Osborne, Weizhu Chen

CoRR, 2019

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding.

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

CoRR, 2019

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering.

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian J. McAuley

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Parameter-free Sentence Embedding via Orthogonal Basis.

Ziyi Yang, Chenguang Zhu, Weizhu Chen

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Multi-Task Deep Neural Networks for Natural Language Understanding.

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Zero-training Sentence Embedding via Orthogonal Basis.

Ziyi Yang, Chenguang Zhu, Weizhu Chen

CoRR, 2018

IncSQL: Training Incremental Text-to-SQL Parsers with Non-Deterministic Oracles.

Tianze Shi, Kedar Tatwawadi, Kaushik Chakrabarti, Yi Mao, Oleksandr Polozov, Weizhu Chen

CoRR, 2018

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Scientific Question Answering.

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian J. McAuley

CoRR, 2018

FusionNet: Fusing via Fully-aware Attention with Application to Machine Comprehension.

Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

Limited-memory Common-directions Method for Distributed Optimization and its Application on Empirical Risk Minimization.

Ching-Pei Lee, Po-Wei Wang, Weizhu Chen, Chih-Jen Lin

Proceedings of the 2017 SIAM International Conference on Data Mining, 2017

2016

ReasoNet: Learning to Stop Reading in Machine Comprehension.

Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen

Proceedings of the Workshop on Cognitive Computation: Integrating neural and symbolic approaches 2016 co-located with the 30th Annual Conference on Neural Information Processing Systems (NIPS 2016), 2016

2014

Large-scale L-BFGS using MapReduce.

Weizhu Chen, Zhenghao Wang, Jingren Zhou

Proceedings of the Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, 2014

Transfer Understanding from Head Queries to Tail Queries.

Yangqiu Song, Haixun Wang, Weizhu Chen, Shusen Wang

Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, 2014

2012

Personalized click model through collaborative filtering.

Si Shen, Botao Amber Hu, Weizhu Chen, Qiang Yang

Proceedings of the Fifth International Conference on Web Search and Web Data Mining, 2012

A noise-aware click model for web search.

Weizhu Chen, Dong Wang, Yuchen Zhang, Zheng Chen, Adish Singla, Qiang Yang

Proceedings of the Fifth International Conference on Web Search and Web Data Mining, 2012

Beyond ten blue links: enabling user click modeling in federated web search.

Danqi Chen, Weizhu Chen, Haixun Wang, Zheng Chen, Qiang Yang

Proceedings of the Fifth International Conference on Web Search and Web Data Mining, 2012

2011

Characterizing search intent diversity into click models.

Botao Amber Hu, Yuchen Zhang, Weizhu Chen, Gang Wang, Qiang Yang

Proceedings of the 20th International Conference on World Wide Web, 2011

Action prediction and identification from mining temporal user behaviors.

Dakan Wang, Gang Wang, Xiaofeng Ke, Weizhu Chen

Proceedings of the Forth International Conference on Web Search and Web Data Mining, 2011

User-click modeling for understanding and predicting search-behavior.

Yuchen Zhang, Weizhu Chen, Dong Wang, Qiang Yang

Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2011

Short Text Conceptualization Using a Probabilistic Knowledgebase.

Yangqiu Song, Haixun Wang, Zhongyuan Wang, Hongsong Li, Weizhu Chen

Proceedings of the IJCAI 2011, 2011

Characterizing Inverse Time Dependency in Multi-class Learning.

Danqi Chen, Weizhu Chen, Qiang Yang

Proceedings of the 11th IEEE International Conference on Data Mining, 2011

A Whole Page Click Model to Better Interpret Search Engine Click Data.

Weizhu Chen, Zhanglong Ji, Si Shen, Qiang Yang

Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, 2011

2010

Co-optimization of multiple relevance metrics in web search.

Dong Wang, Chenguang Zhu, Weizhu Chen, Gang Wang, Zheng Chen

Proceedings of the 19th International Conference on World Wide Web, 2010

A novel click model and its applications to online advertising.

Zeyuan Allen Zhu, Weizhu Chen, Tom Minka, Chenguang Zhu, Zheng Chen

Proceedings of the Third International Conference on Web Search and Web Data Mining, 2010

Incorporating post-click behaviors into a click model.

Feimin Zhong, Dong Wang, Gang Wang, Weizhu Chen, Yuchen Zhang, Zheng Chen, Haixun Wang

Proceedings of the Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010

Learning click models via probit bayesian inference.

Yuchen Zhang, Dong Wang, Gang Wang, Weizhu Chen, Zhihua Zhang, Botao Amber Hu, Li Zhang

Proceedings of the 19th ACM Conference on Information and Knowledge Management, 2010

Explore click models for search ranking.

Dong Wang, Weizhu Chen, Gang Wang, Yuchen Zhang, Botao Amber Hu

Proceedings of the 19th ACM Conference on Information and Knowledge Management, 2010

2009

Inverse Time Dependency in Convex Regularized Learning.

Zeyuan Allen Zhu, Weizhu Chen, Chenguang Zhu, Gang Wang, Haixun Wang, Zheng Chen

Proceedings of the ICDM 2009, 2009

P-packSVM: Parallel Primal grAdient desCent Kernel SVM.

Zeyuan Allen Zhu, Weizhu Chen, Gang Wang, Chenguang Zhu, Zheng Chen

Proceedings of the ICDM 2009, 2009

A general magnitude-preserving boosting algorithm for search ranking.

Chenguang Zhu, Weizhu Chen, Zeyuan Allen Zhu, Gang Wang, Dong Wang, Zheng Chen

Proceedings of the 18th ACM Conference on Information and Knowledge Management, 2009

To divide and conquer search ranking by learning query difficulty.

Zeyuan Allen Zhu, Weizhu Chen, Tao Wan, Chenguang Zhu, Gang Wang, Zheng Chen

Proceedings of the 18th ACM Conference on Information and Knowledge Management, 2009

2008

Web query translation via web log mining.

Rong Hu, Weizhu Chen, Peng Bai, Yansheng Lu, Zheng Chen, Qiang Yang

Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008

Mining Translations of Web Queries from Web Click-through Data.

Rong Hu, Weizhu Chen, Jian Hu, Yansheng Lu, Zheng Chen, Qiang Yang

Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, 2008

2007

Document Transformation for Multi-label Feature Selection in Text Categorization.

Weizhu Chen, Jun Yan, Benyu Zhang, Zheng Chen, Qiang Yang

Proceedings of the 7th IEEE International Conference on Data Mining (ICDM 2007), 2007

Mining Web Query Hierarchies from Clickthrough Data.

Dou Shen, Min Qin, Weizhu Chen, Qiang Yang, Zheng Chen

Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, 2007