Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Short Papers, 2024

Functional Interpolation for Relative Positions improves Long Context Transformers.

[BibT_eX]

[DOI]

Shanda Li

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

GLIMMER: generalized late-interaction memory reranker.

[BibT_eX]

[DOI]

CoRR, 2023

WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset.

[BibT_eX]

[DOI]

CoRR, 2023

Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2023

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Learning Representations, 2023

mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

CoLT5: Faster Long-Range Transformers with Conditional Computation.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extraction.

[BibT_eX]

[DOI]

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

LogicInference: A New Dataset for Teaching Logical Inference to seq2seq Models.

[BibT_eX]

[DOI]

CoRR, 2022

FNet: Mixing Tokens with Fourier Transforms.

[BibT_eX]

[DOI]

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

LongT5: Efficient Text-To-Text Transformer for Long Sequences.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022

Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT.

[BibT_eX]

[DOI]

James Lee-Thorp

Joshua Ainslie

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing.

[BibT_eX]

[DOI]

Proceedings of the 29th International Conference on Computational Linguistics, 2022

Making Transformers Solve Compositional Tasks.

[BibT_eX]

[DOI]

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction.

[BibT_eX]

[DOI]

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Iterative Decoding for Compositional Generalization in Transformers.

[BibT_eX]

[DOI]

Luana Ruiz

Joshua Ainslie

Santiago Ontañón

CoRR, 2021

ShopTalk: A System for Conversational Faceted Search.

[BibT_eX]

[DOI]

CoRR, 2021

ReadTwice: Reading Very Large Documents with Memories.

[BibT_eX]

[DOI]

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Improving Compositional Generalization in Classification Tasks via Structure Annotations.

[BibT_eX]

[DOI]

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

RealFormer: Transformer Likes Residual Attention.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

2020

ETC: Encoding Long and Structured Data in Transformers.

[BibT_eX]

[DOI]