Desmond Elliott

Emanuele Bugliarello

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture.

[BibT_eX]

[DOI]

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

The Role of Data Curation in Image Captioning.

[BibT_eX]

[DOI]

Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, 2024

Understanding Retrieval Robustness for Retrieval-augmented Image Captioning.

[BibT_eX]

[DOI]

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Data Curation for Image Captioning with Text-to-Image Generative Models.

[BibT_eX]

[DOI]

CoRR, 2023

Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation.

[BibT_eX]

[DOI]

Proceedings of the Eighth Conference on Machine Translation, 2023

Cleaner Categories Improve Object Detection and Visual-Textual Grounding.

[BibT_eX]

[DOI]

Davide Rigoni

Proceedings of the Image Analysis - 22nd Scandinavian Conference, 2023

Language Modelling with Pixels.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Text Rendering Strategies for Pixel Language Models.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

PHD: Pixel-Based Language Modeling of Historical Documents.

[BibT_eX]

[DOI]

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Retrieval-augmented Image Captioning.

[BibT_eX]

[DOI]

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

MultiFin: A Dataset for Multilingual Financial NLP.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

Smallcap: Lightweight Image Captioning Prompted with Retrieval Augmentation.

[BibT_eX]

[DOI]

Yova Kementchedjhieva

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification.

[BibT_eX]

[DOI]

Ilias Chalkidis

Xiang Dai

Manos Fergadiotis

Prodromos Malakasiotis

CoRR, 2022

IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2022

Date Recognition in Historical Parish Records.

[BibT_eX]

[DOI]

Laura Cabello Piqueras

Proceedings of the Frontiers in Handwriting Recognition - 18th International Conference, 2022

Multilingual Multimodal Learning with Machine Translated Text.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Revisiting Transformer-based Models for Long Document Classification.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs.

[BibT_eX]

[DOI]

Trans. Assoc. Comput. Linguistics, 2021

Beyond Text and Back Again.

[BibT_eX]

[DOI]

Proceedings of the Companion of The Web Conference 2021, 2021

Probing Cross-Modal Representations in Multi-Step Relational Reasoning.

[BibT_eX]

[DOI]

Proceedings of the 6th Workshop on Representation Learning for NLP, 2021

mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers.

[BibT_eX]

[DOI]

Emanuele Bugliarello

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Visually Grounded Reasoning across Languages and Cultures.

[BibT_eX]

[DOI]

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

The Role of Syntactic Planning in Compositional Image Captioning.

[BibT_eX]

[DOI]

Emanuele Bugliarello

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

2020

Multimodal machine translation through visuals and speech.

[BibT_eX]

[DOI]

Mach. Transl., 2020

Grounded Sequence to Sequence Transduction.

[BibT_eX]

[DOI]

Lucia Specia

Loïc Barrault

Ozan Caglayan

Amanda Cardoso Duarte

IEEE J. Sel. Top. Signal Process., 2020

Multimodal Pretraining Unmasked: Unifying the Vision and Language BERTs.

[BibT_eX]

[DOI]

CoRR, 2020

Multimodal Speech Recognition with Unstructured Audio Masking.

[BibT_eX]

[DOI]

CoRR, 2020

Fine-Grained Grounding for Multimodal Speech Recognition.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Textual supervision for visually grounded spoken language understanding.

[BibT_eX]

[DOI]

Bertrand Higy

Grzegorz Chrupala

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning.

[BibT_eX]

[DOI]

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

On Forgetting to Cite Older Papers: An Analysis of the ACL Anthology.

[BibT_eX]

[DOI]

Marcel Bollmann

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

The Sensitivity of Language Models and Humans to Winograd Schema Perturbations.

[BibT_eX]

[DOI]

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning.

[BibT_eX]

[DOI]

CoRR, 2019

Cross-lingual Visual Verb Sense Disambiguation.

[BibT_eX]

[DOI]

Spandana Gella

Frank Keller

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Understanding the Effect of Textual Adversaries in Multimodal Machine Translation.

[BibT_eX]

[DOI]

Koel Dutta Chowdhury

Proceedings of the Beyond Vision and LANguage: inTEgrating Real-world kNowledge, 2019

Adversarial Removal of Demographic Attributes Revisited.

[BibT_eX]

[DOI]

Maria Barrett

Yova Kementchedjhieva

Yanai Elazar

Anders Søgaard

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Compositional Generalization in Image Captioning.

[BibT_eX]

[DOI]

Proceedings of the 23rd Conference on Computational Natural Language Learning, 2019

2018

Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices.

[BibT_eX]

[DOI]

Lucia Specia

Nat. Lang. Eng., 2018

How2: A Large-scale Dataset for Multimodal Language Understanding.

[BibT_eX]

[DOI]

CoRR, 2018

Findings of the Third Shared Task on Multimodal Machine Translation.

[BibT_eX]

[DOI]

Proceedings of the Third Conference on Machine Translation: Shared Task Papers, 2018

Talking about other people: an endless range of possibilities.

[BibT_eX]

[DOI]

Piek Vossen

Proceedings of the 11th International Conference on Natural Language Generation, 2018

Adversarial Evaluation of Multimodal Machine Translation.

[BibT_eX]

[DOI]

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Lessons Learned in Multilingual Grounded Language Learning.

[BibT_eX]

[DOI]

Proceedings of the 22nd Conference on Computational Natural Language Learning, 2018

Measuring the Diversity of Automatic Image Descriptions.

[BibT_eX]

[DOI]

Piek Vossen

Proceedings of the 27th International Conference on Computational Linguistics, 2018

2017

Room for improvement in automatic image description: an error analysis.

[BibT_eX]

[DOI]

CoRR, 2017

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description.

[BibT_eX]

[DOI]

Proceedings of the Second Conference on Machine Translation, 2017

Cross-linguistic differences and similarities in image descriptions.

[BibT_eX]

[DOI]

Piek Vossen

Proceedings of the 10th International Conference on Natural Language Generation, 2017

Imagination Improves Multimodal Translation.

[BibT_eX]

[DOI]

Ákos Kádár

Proceedings of the Eighth International Joint Conference on Natural Language Processing, 2017

Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures (Extended Abstract).

[BibT_eX]

[DOI]

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017

Exploring Concept Representations for Concept Drift Detection.

[BibT_eX]

[DOI]

Oliver Becher

Laura Hollink

Proceedings of the Joint Proceedings of SEMANTiCS 2017 Workshops co-located with the 13th International Conference on Semantic Systems (SEMANTiCS 2017), 2017

2016

Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures.

[BibT_eX]

[DOI]

J. Artif. Intell. Res., 2016

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description.

[BibT_eX]

[DOI]

Proceedings of the First Conference on Machine Translation, 2016

DCU-UvA Multimodal MT System Report.

[BibT_eX]

[DOI]

Iacer Calixto

Proceedings of the First Conference on Machine Translation, 2016

A Corpus of Images and Text in Online News.

[BibT_eX]

[DOI]

Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, 2016

1 Million Captioned Dutch Newspaper Images.

[BibT_eX]

[DOI]

Martijn Kleppe

Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, 2016

1 Million Dutch Newspaper Images available for researchers: The KBK-1M Dataset.

[BibT_eX]

[DOI]

Martijn Kleppe

Proceedings of the 11th Annual International Conference of the Alliance of Digital Humanities Organizations, 2016

Pragmatic Factors in Image Description: The Case of Negations.

[BibT_eX]

[DOI]

Roser Morante

Proceedings of the 5th Workshop on Vision and Language, 2016

Multi30K: Multilingual English-German Image Descriptions.

[BibT_eX]

[DOI]

Proceedings of the 5th Workshop on Vision and Language, 2016

2015

Structured representation of images for language generation and image retrieval

[BibT_eX]

[DOI]

PhD thesis, 2015

Multi-Language Image Description with Neural Sequence Models.

[BibT_eX]

[DOI]

Eva Hasler

CoRR, 2015

Describing Images using Inferred Visual Dependency Representations.

[BibT_eX]

[DOI]

Arjen P. de Vries

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Query-by-Example Image Retrieval using Visual Dependency Representations.

[BibT_eX]

[DOI]

Victor Lavrenko

Frank Keller

Proceedings of the COLING 2014, 2014

Comparing Automatic Evaluation Measures for Image Description.

[BibT_eX]

[DOI]