Timo Breuer

Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, 2024

Evaluation of Temporal Change in IR Test Collections.

[BibT_eX]

[DOI]

Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, 2024

Context-Driven Interactive Query Simulations Based on Generative Large Language Models.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2024

Replicability Measures for Longitudinal Information Retrieval Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2024

Leveraging Prior Relevance Signals in Web Search.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs.

[BibT_eX]

[DOI]

Anh Thu Maria Bui

Saskia Felizitas Brech

Narjes Nikzad-Khasmakhi

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users.

[BibT_eX]

[DOI]

Maria Maistro

Proceedings of the 2nd ACM Conference on Reproducibility and Replicability, 2024

2023

Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.

[BibT_eX]

[DOI]

SIGIR Forum, June, 2023

An in-depth investigation on the behavior of measures to quantify reproducibility.

[BibT_eX]

[DOI]

Inf. Process. Manag., May, 2023

Reproducible Information Retrieval Research: From Principled System-Oriented Evaluations Towards User-Oriented Experimentation.

[BibT_eX]

[DOI]

PhD thesis, 2023

Bibliometric Data Fusion for Biomedical Information Retrieval.

[BibT_eX]

[DOI]

Christin Katharina Kreutz

Dirk Tunger

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, 2023

Evaluating Temporal Persistence Using Replicability Measures.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

Simulating Users in Interactive Web Table Retrieval.

[BibT_eX]

[DOI]

Björn Engelmann

Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023

2022

An in-depth Investigation on the Behaviour of Measures to Quantify Reproducibility.

[BibT_eX]

[DOI]

Dataset, January, 2022

Relevance assessments, bibliometrics, and altmetrics: a quantitative study on PubMed and arXiv.

[BibT_eX]

[DOI]

Dirk Tunger

Scientometrics, 2022

Online Information Retrieval Evaluation using the STELLA Framework.

[BibT_eX]

[DOI]

CoRR, 2022

ir_metadata: An Extensible Metadata Schema for IR Experiments.

[BibT_eX]

[DOI]

Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

Validating Simulations of User Query Variants.

[BibT_eX]

[DOI]

Norbert Fuhr

Proceedings of the Advances in Information Retrieval, 2022

2021

A Living Lab Architecture for Reproducible Shared Task Experimentation.

[BibT_eX]

[DOI]

Proceedings of the Information between Data and Knowledge: Information Science and its Neighbors from Data Science to Digital Humanities, 2021

repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2021

Overview of LiLAS 2021 - Living Labs for Academic Search.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2021

Overview of LiLAS 2021 - Living Labs for Academic Search (Extended Overview).

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, Bucharest, Romania, September 21st - to, 2021

Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval.

[BibT_eX]

[DOI]

Melanie Pest

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2021

2020

Evaluation Infrastructures for Academic Shared Tasks.

[BibT_eX]

[DOI]

Johann Schaible

Bernd Müller

Benjamin Wolff

Datenbank-Spektrum, 2020

How to Measure the Reproducibility of System-oriented IR Experiments.

[BibT_eX]

[DOI]

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Reproducible Online Search Experiments.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2020

Relations Between Relevance Assessments, Bibliometrics and Altmetrics.

[BibT_eX]

[DOI]

Dirk Tunger

Proceedings of the 10th International Workshop on Bibliometric-enhanced Information Retrieval co-located with 42nd European Conference on Information Retrieval, 2020

2019

STELLA: Towards a Framework for the Reproducibility of Online Search Experiments.

[BibT_eX]

[DOI]

Johann Schaible

Benjamin Wolff

Bernd Müller

Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

Dockerizing Automatic Routing Runs for The Open-Source IR Replicability Challenge (OSIRRC 2019).

[BibT_eX]

[DOI]

Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

Replicability and Reproducibility of Automatic Routing Runs.

[BibT_eX]

[DOI]