Nitika Mathur

According to our database, Nitika Mathur authored at least 14 papers between 2014 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie

Proceedings of the Ninth Conference on Machine Translation, 2024

Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy.

Brian Thompson, Nitika Mathur, Daniel Deutsch, Huda Khayrallah

Proceedings of the Ninth Conference on Machine Translation, 2024

2023

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent.

Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster

Proceedings of the Eighth Conference on Machine Translation, 2023

2022

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust.

Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

2021

Robustness in Machine Translation Evaluation.

Nitika Mathur

PhD thesis, 2021

Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain.

Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar

Proceedings of the Sixth Conference on Machine Translation, 2021

2020

Results of the WMT20 Metrics Shared Task.

Nitika Mathur, Johnny Wei, Markus Freitag, Qingsong Ma, Ondrej Bojar

Proceedings of the Fifth Conference on Machine Translation, 2020

Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics.

Nitika Mathur, Timothy Baldwin, Trevor Cohn

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Putting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation.

Nitika Mathur, Timothy Baldwin, Trevor Cohn

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Towards Efficient Machine Translation Evaluation by Modelling Annotators.

Nitika Mathur, Timothy Baldwin, Trevor Cohn

Proceedings of the Australasian Language Technology Association Workshop 2018, 2018

2017

Sequence Effects in Crowdsourced Annotations.

Nitika Mathur, Timothy Baldwin, Trevor Cohn

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017

2015

Accurate Evaluation of Segment-level Machine Translation Metrics.

Yvette Graham, Timothy Baldwin, Nitika Mathur

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

The Impact of Multiword Expression Compositionality on Machine Translation Evaluation.

Bahar Salehi, Nitika Mathur, Paul Cook, Timothy Baldwin

Proceedings of the 11th Workshop on Multiword Expressions, 2015

2014

Randomized Significance Tests in Machine Translation.

Yvette Graham, Nitika Mathur, Timothy Baldwin

Proceedings of the Ninth Workshop on Statistical Machine Translation, 2014