Daniel Deutsch

Yufang Hou

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Short Papers, 2024

2023

Pinpoint, Not Criticize: Refining Large Language Models via Fine-Grained Actionable Feedback.

[BibT_eX]

[DOI]

CoRR, 2023

The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation.

[BibT_eX]

[DOI]

CoRR, 2023

Ties Matter: Modifying Kendall's Tau for Modern Metric Meta-Evaluation.

[BibT_eX]

[DOI]

George F. Foster

CoRR, 2023

There's No Data like Better Data: Using QE Metrics for MT Data Filtering.

[BibT_eX]

[DOI]

Proceedings of the Eighth Conference on Machine Translation, 2023

Quality Estimation Using Minimum Bayes Risk.

[BibT_eX]

[DOI]

Subhajit Naskar

Proceedings of the Eighth Conference on Machine Translation, 2023

MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task.

[BibT_eX]

[DOI]

Proceedings of the Eighth Conference on Machine Translation, 2023

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent.

[BibT_eX]

[DOI]

Nitika Mathur

Chi-kiu Lo

Eleftherios Avramidis

Proceedings of the Eighth Conference on Machine Translation, 2023

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Eighth Conference on Machine Translation, 2023

Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level.

[BibT_eX]

[DOI]

Proceedings of the Eighth Conference on Machine Translation, 2023

The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics.

[BibT_eX]

[DOI]

Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems, 2023

Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration.

[BibT_eX]

[DOI]

George F. Foster

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection.

[BibT_eX]

[DOI]

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization.

[BibT_eX]

[DOI]

João Sedoc

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Needle in a Haystack: An Analysis of Finding Qualified Workers on MTurk for Summarization.

[BibT_eX]

[DOI]

CoRR, 2022

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code.

[BibT_eX]

[DOI]

Alexandros Papangelis

Aman Madaan

Angelina McMillan-Major

Pawan Sasanka Ammanamanchi

Laura Perez-Beltrachini

Leonardo F. R. Ribeiro

CoRR, 2022

Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code.

[BibT_eX]

[DOI]

CoRR, 2022

Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics.

[BibT_eX]

[DOI]

Rotem Dror

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

On the Limitations of Reference-Free Evaluations of Generated Text.

[BibT_eX]

[DOI]

Rotem Dror

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

2021

A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods.

[BibT_eX]

[DOI]

Rotem Dror

Trans. Assoc. Comput. Linguistics, 2021

Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary.

[BibT_eX]

[DOI]

Tania Bedrax-Weiss

Trans. Assoc. Comput. Linguistics, 2021

Question-Based Salient Span Selection for More Controllable Text Summarization.

[BibT_eX]

[DOI]

CoRR, 2021

Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries.

[BibT_eX]

[DOI]

Proceedings of the 25th Conference on Computational Natural Language Learning, 2021

2020

Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries.

[BibT_eX]

[DOI]

CoRR, 2020

SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics.

[BibT_eX]

[DOI]

CoRR, 2020

Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection.

[BibT_eX]

[DOI]

Disha Jindal

Proceedings of the 28th International Conference on Computational Linguistics, 2020

2019

Summary Cloze: A New Task for Content Selection in Topic-Focused Summarization.

[BibT_eX]

[DOI]

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

A General-Purpose Algorithm for Constrained Sequential Inference.

[BibT_eX]

[DOI]

Shyam Upadhyay

Proceedings of the 23rd Conference on Computational Natural Language Learning, 2019

2018

A Distributional and Orthographic Aggregation Model for English Derivational Morphology.

[BibT_eX]

[DOI]