Tom Kocmi

According to our database, Tom Kocmi authored at least 56 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Preliminary WMT24 Ranking of General MT Systems and LLMs.

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar

CoRR, 2024

AI-Assisted Human Evaluation of Machine Translation.

Vilém Zouhar, Tom Kocmi, Mrinmaya Sachan

CoRR, 2024

Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets.

Nikita Moghe, Arnisa Fazla, Chantal Amrhein, Tom Kocmi, Mark Steedman, Alexandra Birch, Rico Sennrich, Liane Guillou

CoRR, 2024

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation.

Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova

Proceedings of the Ninth Conference on Machine Translation, 2024

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet.

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Christof Monz, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinthór Steingrímsson, Vilém Zouhar

Proceedings of the Ninth Conference on Machine Translation, 2024

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie

Proceedings of the Ninth Conference on Machine Translation, 2024

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References.

Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Wayne Xin Zhao, Tom Kocmi, Furu Wei

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window.

Vikas Raunak, Tom Kocmi, Matt Post

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Short Papers, 2024

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models.

Qingyu Lu, Baopu Qiu, Liang Ding, Kanjian Zhang, Tom Kocmi, Dacheng Tao

Proceedings of the Findings of the Association for Computational Linguistics, 2024

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies.

Tom Kocmi, Vilém Zouhar, Christian Federmann, Matt Post

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies.

Kirill Semenov, Vilém Zouhar, Tom Kocmi, Dongdong Zhang, Wangchunshu Zhou, Yuchen Eleanor Jiang

Proceedings of the Eighth Conference on Machine Translation, 2023

Evaluating Metrics for Document-context Evaluation in Machine Translation.

Vikas Raunak, Tom Kocmi, Matt Post

Proceedings of the Eighth Conference on Machine Translation, 2023

GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4.

Tom Kocmi, Christian Federmann

Proceedings of the Eighth Conference on Machine Translation, 2023

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet.

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova

Proceedings of the Eighth Conference on Machine Translation, 2023

Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics.

Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt

Proceedings of the Eighth Conference on Machine Translation, 2023

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent.

Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster

Proceedings of the Eighth Conference on Machine Translation, 2023

eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings.

Muhammad N. ElNokrashy, Tom Kocmi

Proceedings of the Eighth Conference on Machine Translation, 2023

Overview of the Second Shared Task on Automatic Minuting (AutoMin) at INLG 2023.

Tirthankar Ghosal, Ondrej Bojar, Marie Hledíková, Tom Kocmi, Anna Nedoluzhko

Proceedings of the 16th International Natural Language Generation Conference, 2023

Large Language Models Are State-of-the-Art Evaluators of Translation Quality.

Tom Kocmi, Christian Federmann

Proceedings of the 24th Annual Conference of the European Association for Machine Translation, 2023

Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference.

Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

2022

The Reality of Multi-Lingual Machine Translation.

Tom Kocmi, Dominik Machácek, Ondrej Bojar

CoRR, 2022

Searching for a Higher Power in the Human Evaluation of MT.

Johnny Tian-Zheng Wei, Tom Kocmi, Christian Federmann

Proceedings of the Seventh Conference on Machine Translation, 2022

MS-COMET: More and Better Human Judgements Improve Metric Performance.

Tom Kocmi, Hitokazu Matsushita, Christian Federmann

Proceedings of the Seventh Conference on Machine Translation, 2022

Findings of the 2022 Conference on Machine Translation (WMT22).

Tom Kocmi, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Thamme Gowda, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Rebecca Knowles, Philipp Koehn, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Michal Novák, Martin Popel, Maja Popovic

Proceedings of the Seventh Conference on Machine Translation, 2022

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust.

Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

2021

On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs.

Roman Grundkiewicz, Marcin Junczys-Dowmunt, Christian Federmann, Tom Kocmi

CoRR, 2021

To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation.

Tom Kocmi, Christian Federmann, Roman Grundkiewicz, Marcin Junczys-Dowmunt, Hitokazu Matsushita, Arul Menezes

Proceedings of the Sixth Conference on Machine Translation, 2021

Findings of the 2021 Conference on Machine Translation (WMT21).

Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondrej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussà, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, Marcos Zampieri

Proceedings of the Sixth Conference on Machine Translation, 2021

When a Robot Writes a Play: Automatically Generating a Theatre Play Script.

Rudolf Rosa, Tomás Musil, Ondrej Dusek, Dominik Jurko, Patrícia Schmidtová, David Marecek, Ondrej Bojar, Tom Kocmi, Daniel Hrbek, David Kosták, Martina Kinská, Marie Nováková, Josef Dolezal, Klára Vosecká, Tomás Studeník, Petr Zabka

Proceedings of the 2021 Conference on Artificial Life, 2021

THEaiTRE 1.0: Interactive Generation of Theatre Play Scripts.

Rudolf Rosa, Tomás Musil, Ondrej Dusek, Dominik Jurko, Patrícia Schmidtová, David Marecek, Ondrej Bojar, Tom Kocmi, Daniel Hrbek, David Kosták, Martina Kinská, Marie Nováková, Josef Dolezal, Klára Vosecká, Tomás Studeník, Petr Zabka

Proceedings of Text2Story, 2021

2020

Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords.

Tom Kocmi, Martin Popel, Ondrej Bojar

CoRR, 2020

Exploring Benefits of Transfer Learning in Neural Machine Translation.

Tom Kocmi

CoRR, 2020

CUNI Systems for the Unsupervised and Very Low Resource Translation Task in WMT20.

Ivana Kvapilíková, Tom Kocmi, Ondrej Bojar

Proceedings of the Fifth Conference on Machine Translation, 2020

Gender Coreference and Bias Evaluation at WMT 2020.

Tom Kocmi, Tomasz Limisiewicz, Gabriel Stanovsky

Proceedings of the Fifth Conference on Machine Translation, 2020

CUNI Submission for the Inuktitut Language in WMT News 2020.

Tom Kocmi

Proceedings of the Fifth Conference on Machine Translation, 2020

Findings of the 2020 Conference on Machine Translation (WMT20).

Loïc Barrault, Magdalena Biesialska, Ondrej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubesic, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, Marcos Zampieri

Proceedings of the Fifth Conference on Machine Translation, 2020

THEaiTRE: Artificial Intelligence to Write a Theatre Play.

Rudolf Rosa, Ondrej Dusek, Tom Kocmi, David Marecek, Tomás Musil, Patrícia Schmidtová, Dominik Jurko, Ondrej Bojar, Daniel Hrbek, David Kosták, Martina Kinská, Josef Dolezal, Klára Vosecká

Proceedings of AI4Narratives, 2020

Efficiently Reusing Old Models Across Languages via Transfer Learning.

Tom Kocmi, Ondrej Bojar

Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 2020

2019

Transfer Learning across Languages from Someone Else's NMT Model.

Tom Kocmi, Ondrej Bojar

CoRR, 2019

CUNI Submission for Low-Resource Languages in WMT News 2019.

Tom Kocmi, Ondrej Bojar

Proceedings of the Fourth Conference on Machine Translation, 2019

2018

CUNI Submissions in WMT18.

Tom Kocmi, Roman Sudarikov, Ondrej Bojar

Proceedings of the Third Conference on Machine Translation: Shared Task Papers, 2018

Trivial Transfer Learning for Low-Resource Neural Machine Translation.

Tom Kocmi, Ondrej Bojar

Proceedings of the Third Conference on Machine Translation: Research Papers, 2018

SumeCzech: Large Czech News-Based Summarization Dataset.

Milan Straka, Nikita Mediankin, Tom Kocmi, Zdenek Zabokrtský, Vojtech Hudecek, Jan Hajic

Proceedings of the Eleventh International Conference on Language Resources and Evaluation, 2018

CUNI Basque-to-English Submission in IWSLT18.

Tom Kocmi, Dusan Varis, Ondrej Bojar

Proceedings of the 15th International Conference on Spoken Language Translation, 2018

Neural Monkey: The Current State and Beyond.

Jindrich Helcl, Jindrich Libovický, Tom Kocmi, Tomás Musil, Ondrej Cífka, Dusan Varis, Ondrej Bojar

Proceedings of the 13th Conference of the Association for Machine Translation in the Americas, 2018

CUNI NMT System for WAT 2018 Translation Tasks.

Tom Kocmi, Shantipriya Parida, Ondrej Bojar

Proceedings of the 32nd Pacific Asia Conference on Language, 2018

2017

LanideNN: Multilingual Language Identification on Character Window.

Tom Kocmi, Ondrej Bojar

CoRR, 2017

CUNI submission in WMT17: Chimera goes neural.

Roman Sudarikov, David Marecek, Tom Kocmi, Dusan Varis, Ondrej Bojar

Proceedings of the Second Conference on Machine Translation, 2017

Results of the WMT17 Neural MT Training Task.

Ondrej Bojar, Jindrich Helcl, Tom Kocmi, Jindrich Libovický, Tomás Musil

Proceedings of the Second Conference on Machine Translation, 2017

Curriculum Learning and Minibatch Bucketing in Neural Machine Translation.

Tom Kocmi, Ondrej Bojar

Proceedings of the International Conference Recent Advances in Natural Language Processing, 2017

An Exploration of Word Embedding Initialization in Deep-Learning Tasks.

Tom Kocmi, Ondrej Bojar

Proceedings of the 14th International Conference on Natural Language Processing, 2017

LanideNN: Multilingual Language Identification on Text Stream.

Tom Kocmi, Ondrej Bojar

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

CUNI NMT System for WAT 2017 Translation Tasks.

Tom Kocmi, Dusan Varis, Ondrej Bojar

Proceedings of the 4th Workshop on Asian Translation, 2017

2016

SubGram: Extending Skip-Gram Word Representation with Substrings.

Tom Kocmi, Ondrej Bojar

Proceedings of the Text, Speech, and Dialogue - 19th International Conference, 2016

CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered.

Ondrej Bojar, Ondrej Dusek, Tom Kocmi, Jindrich Libovický, Michal Novák, Martin Popel, Roman Sudarikov, Dusan Varis

Proceedings of the Text, Speech, and Dialogue - 19th International Conference, 2016

UFAL Submissions to the IWSLT 2016 MT Track.

Ondrej Bojar, Ondrej Cífka, Jindrich Helcl, Tom Kocmi, Roman Sudarikov

Proceedings of the 13th International Conference on Spoken Language Translation, 2016