Ahmet Üstün

According to our database, Ahmet Üstün authored at least 35 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions.

Abdullatif Köksal, Marion Thaler, Ayyoob Imani, Ahmet Üstün, Anna Korhonen, Hinrich Schütze

CoRR, 2024

Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts.

Nikolas Gritsch, Qizhen Zhang, Acyr Locatelli, Sara Hooker, Ahmet Üstün

CoRR, 2024

To Code, or Not To Code? Exploring Impact of Code in Pre-training.

Viraat Aryabumi, Yixuan Su, Raymond Ma, Adrien Morisot, Ivan Zhang, Acyr Locatelli, Marzieh Fadaee, Ahmet Üstün, Sara Hooker

CoRR, 2024

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts.

Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob N. Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli

CoRR, 2024

Aya 23: Open Weight Releases to Further Multilingual Progress.

Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker

CoRR, 2024

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning.

Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje F. Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker

CoRR, 2024

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning.

Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker

Proceedings of the Twelfth International Conference on Learning Representations, 2024

How Does Quantization Affect Multilingual LLMs?

Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs.

John Dang, Arash Ahmadian, Kelly Marchisio, Julia Kreutzer, Ahmet Üstün, Sara Hooker

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model.

Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning.

Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs.

Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, Sara Hooker

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale.

Max Marion, Ahmet Üstün, Luiza Pozzobon, Alex Wang, Marzieh Fadaee, Sara Hooker

CoRR, 2023

Intriguing Properties of Quantization at Scale.

Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker

CoRR, 2023

Intriguing Properties of Quantization at Scale.

Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Zhen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

UDapter: Typology-based Language Adapters for Multilingual Dependency Parsing and Sequence Labeling.

Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord

Comput. Linguistics, 2022

When does Parameter-Efficient Transfer Learning Work for Machine Translation?

Ahmet Üstün, Asa Cooper Stickland

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer.

Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

On the Difficulty of Translating Free-Order Case-Marking Languages.

Arianna Bisazza, Ahmet Üstün, Stephan Sportel

Trans. Assoc. Comput. Linguistics, 2021

Incorporating word embeddings in unsupervised morphological segmentation.

Ahmet Üstün, Burcu Can

Nat. Lang. Eng., 2021

On the Effectiveness of Dataset Embeddings in Mono-lingual, Multi-lingual and Zero-shot Conditions.

Rob van der Goot, Ahmet Üstün, Barbara Plank

CoRR, 2021

Unsupervised Translation of German-Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language.

Lukas Edman, Ahmet Üstün, Antonio Toral, Gertjan van Noord

Proceedings of the Sixth Conference on Machine Translation, 2021

From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding.

Rob van der Goot, Ibrahim Sharaf, Aizhan Imankulova, Ahmet Üstün, Marija Stepanovic, Alan Ramponi, Siti Oryza Khairunnisa, Mamoru Komachi, Barbara Plank

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Automatic Judgement Forecasting for Pending Applications of the European Court of Human Rights.

Masha Medvedeva, Ahmet Üstün, Xiao Xu, Michel Vols, Martijn Wieling

Proceedings of the Joint Proceedings of the Workshops on Automated Semantic Analysis of Information in Legal Text (ASAIL 2021) & AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2021) held online in conjunction with 18th International Conference on Artificial Intelligence and Law (ICAIL 2021), 2021

Multilingual Unsupervised Neural Machine Translation with Denoising Adapters.

Ahmet Üstün, Alexandre Berard, Laurent Besacier, Matthias Gallé

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP.

Rob van der Goot, Ahmet Üstün, Alan Ramponi, Ibrahim Sharaf, Barbara Plank

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, 2021

2020

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP.

Rob van der Goot, Ahmet Üstün, Alan Ramponi, Barbara Plank

CoRR, 2020

FiSSA at SemEval-2020 Task 9: Fine-tuned for Feelings.

Bertelt Braaksma, Richard Scholtens, Stan van Suijlekom, Remy Wang, Ahmet Üstün

Proceedings of the Fourteenth Workshop on Semantic Evaluation, 2020

UDapter: Language Adaptation for Truly Universal Dependency Parsing.

Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

2019

Cross-Lingual Word Embeddings for Morphologically Rich Languages.

Ahmet Üstün, Gosse Bouma, Gertjan van Noord

Proceedings of the International Conference on Recent Advances in Natural Language Processing, 2019

There and Back Again: Cross-Lingual Transfer Learning for Event Detection.

Tommaso Caselli, Ahmet Üstün

Proceedings of the Sixth Italian Conference on Computational Linguistics, 2019

2018

Characters or Morphemes: How to Represent Words?

Ahmet Üstün, Murathan Kurfali, Burcu Can

Proceedings of The Third Workshop on Representation Learning for NLP, 2018

2017

A Trie-structured Bayesian Model for Unsupervised Morphological Segmentation.

Murathan Kurfali, Ahmet Üstün, Burcu Can

Proceedings of the Computational Linguistics and Intelligent Text Processing, 2017

2016

Unsupervised Morphological Segmentation Using Neural Word Embeddings.

Ahmet Üstün, Burcu Can

Proceedings of the Statistical Language and Speech Processing, 2016

Turkish PoS Tagging by Reducing Sparsity with Morpheme Tags in Small Datasets.

Burcu Can, Ahmet Üstün, Murathan Kurfali

Proceedings of the Computational Linguistics and Intelligent Text Processing, 2016