Canwen Xu

According to our database, Canwen Xu authored at least 40 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Format Restriction, and Column Exploration.

Minghang Deng, Ashwin Ramachandran, Canwen Xu, Lanxiang Hu, Zhewei Yao, Anupam Datta, Hao Zhang

CoRR, February, 2025

2024

Efficient Natural Language Processing for Language Models

Canwen Xu

PhD thesis, 2024

StarCoder 2 and The Stack v2: The Next Generation.

Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, Joel Lamy-Poirier, Nouamane Tazi, Ao Tang, Dmytro Pykhtar, Jiawei Liu, Yuxiang Wei, Tianyang Liu, Max Tian, Denis Kocetkov, Arthur Zucker, Younes Belkada, Zijian Wang, Qian Liu, Dmitry Abulkhanov, Indraneil Paul, Zhuang Li, Wen-Ding Li, Megan Risdal, Jia Li, Jian Zhu, Terry Yue Zhuo, Evgenii Zheltonozhskii, Nii Osae Osae Dade, Wenhao Yu, Lucas Krauß, Naman Jain, Yixuan Su, Xuanli He, Manan Dey, Edoardo Abati, Yekun Chai, Niklas Muennighoff, Xiangru Tang, Muhtasham Oblokulov, Christopher Akiki, Marc Marone, Chenghao Mou, Mayank Mishra, Alex Gu, Binyuan Hui, Tri Dao, Armel Zebaze, Olivier Dehaene, Nicolas Patry, Canwen Xu, Julian J. McAuley, Han Hu, Torsten Scholak, Sébastien Paquet, Jennifer Robinson, Carolyn Jane Anderson, Nicolas Chapados, et al.

CoRR, 2024

Automatic Pair Construction for Contrastive Post-training.

Canwen Xu, Corby Rosset, Ethan C. Chau, Luciano Del Corro, Shweti Mahajan, Julian J. McAuley, Jennifer Neville, Ahmed Awadallah, Nikhil Rao

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

Tianyang Liu, Canwen Xu, Julian J. McAuley

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Small Models are Valuable Plug-ins for Large Language Models.

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian J. McAuley

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Contrastive Post-training Large Language Models on Data Curriculum.

Canwen Xu, Corby Rosset, Luciano Del Corro, Shweti Mahajan, Julian J. McAuley, Jennifer Neville, Ahmed Hassan Awadallah, Nikhil Rao

CoRR, 2023

Mirror: A Natural Language Interface for Data Querying, Summarization, and Visualization.

Canwen Xu, Julian J. McAuley, Penghan Wang

Proceedings of the Companion Proceedings of the ACM Web Conference 2023, 2023

LongCoder: A Long-Range Pre-trained Language Model for Code Completion.

Daya Guo, Canwen Xu, Nan Duan, Jian Yin, Julian J. McAuley

Proceedings of the International Conference on Machine Learning, 2023

Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Data.

Canwen Xu, Daya Guo, Nan Duan, Julian J. McAuley

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Spoiler Detection as Semantic Text Matching.

Ryan Tran, Canwen Xu, Julian J. McAuley

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

A Survey on Dynamic Neural Networks for Natural Language Processing.

Canwen Xu, Julian J. McAuley

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

A Survey on Model Compression and Acceleration for Pretrained Language Models.

Canwen Xu, Julian J. McAuley

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav, Canwen Xu, Chenghao Mou, Chris Emezue, Christopher Klamm, Colin Leong, Daniel van Strien, David Ifeoluwa Adelani, et al.

CoRR, 2022

A Survey on Model Compression for Natural Language Processing.

Canwen Xu, Julian J. McAuley

CoRR, 2022

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts.

Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Mike Tian-Jian Jiang, Alexander M. Rush

CoRR, 2022

Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification.

Han Wang, Canwen Xu, Julian J. McAuley

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Multitask Prompted Training Enables Zero-Shot Task Generalization.

Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Teven Le Scao, Stella Biderman, Leo Gao, Thomas Wolf, Alexander M. Rush

Proceedings of the Tenth International Conference on Learning Representations, 2022

Efficiently Tuned Parameters Are Task Embeddings.

Wangchunshu Zhou, Canwen Xu, Julian J. McAuley

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

InforMask: Unsupervised Informative Masking for Language Model Pretraining.

Nafis Sadeq, Canwen Xu, Julian J. McAuley

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

BERT Learns to Teach: Knowledge Distillation with Meta Learning.

Wangchunshu Zhou, Canwen Xu, Julian J. McAuley

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval.

Canwen Xu, Daya Guo, Nan Duan, Julian J. McAuley

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts.

Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Dragomir R. Radev, Mike Tian-Jian Jiang, Alexander M. Rush

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 2022

Leashing the Inner Demons: Self-Detoxification for Language Models.

Canwen Xu, Zexue He, Zhankui He, Julian J. McAuley

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Multitask Prompted Training Enables Zero-Shot Task Generalization.

Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush

CoRR, 2021

Meta Learning for Knowledge Distillation.

Wangchunshu Zhou, Canwen Xu, Julian J. McAuley

CoRR, 2021

Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge.

Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian J. McAuley, Furu Wei

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting.

Wangchunshu Zhou, Tao Ge, Canwen Xu, Ke Xu, Furu Wei

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression.

Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian J. McAuley, Furu Wei

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Datasets: A Community Library for Natural Language Processing.

Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, Joe Davison, Mario Sasko, Gunjan Chhablani, Bhavitvya Malik, Simon Brandeis, Teven Le Scao, Victor Sanh, Canwen Xu, Nicolas Patry, Angelina McMillan-Major, Philipp Schmid, Sylvain Gugger, Clément Delangue, Théo Matussière, Lysandre Debut, Stas Bekman, Pierric Cistac, Thibault Goehringer, Victor Mustar, François Lagunas, Alexander M. Rush, Thomas Wolf

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2021

2020

BERT Loses Patience: Fast and Robust Inference with Early Exit.

Wangchunshu Zhou, Canwen Xu, Tao Ge, Julian J. McAuley, Ke Xu, Furu Wei

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database.

Canwen Xu, Tao Ge, Chenliang Li, Furu Wei

Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, 2020

BERT-of-Theseus: Compressing BERT by Progressive Module Replacing.

Canwen Xu, Wangchunshu Zhou, Tao Ge, Furu Wei, Ming Zhou

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Transformers: State-of-the-Art Natural Language Processing.

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2020

MATINF: A Jointly Labeled Large-Scale Dataset for Classification, Question Answering and Summarization.

Canwen Xu, Jiaxin Pei, Hongtao Wu, Yiyu Liu, Chenliang Li

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders.

Yu Duan, Canwen Xu, Jiaxin Pei, Jialong Han, Chenliang Li

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders.

Yu Duan, Jiaxin Pei, Canwen Xu, Chenliang Li

CoRR, 2019

Obj-GloVe: Scene-Based Contextual Object Embedding.

Canwen Xu, Zhenzhong Chen, Chenliang Li

CoRR, 2019

DLocRL: A Deep Learning Pipeline for Fine-Grained Location Recognition and Linking in Tweets.

Canwen Xu, Jing Li, Xiangyang Luo, Jiaxin Pei, Chenliang Li, Donghong Ji

Proceedings of the World Wide Web Conference, 2019

Exploiting Multiple Embeddings for Chinese Named Entity Recognition.

Canwen Xu, Feiyang Wang, Jialong Han, Chenliang Li

Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019