Nicola Ferro

Proceedings of the 20th Conference on Information and Research science Connecting to Digital and Library science (formerly the Italian Research Conference on Digital Libraries), Bressanone, Brixen, Italy, 2024

Improving RAG Systems via Sentence Clustering and Reordering.

[BibT_eX]

[DOI]

Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024) co-located with the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024), 2024

A Quantum Annealing-Based Instance Selection Approach for Transformer Fine-Tuning.

[BibT_eX]

[DOI]

Washington Cunha

Marcos André Gonçalves

Francesco Luigi De Faveri

Proceedings of the 14th Italian Information Retrieval Workshop, 2024

The CAMEO Project: A Holistic View for Conversational Agents.

[BibT_eX]

[DOI]

Proceedings of the 14th Italian Information Retrieval Workshop, 2024

Beyond the Parameters: Measuring Actual Privacy in Obfuscated Texts.

[BibT_eX]

[DOI]

Proceedings of the 14th Italian Information Retrieval Workshop, 2024

Turning on a DIME: Estimating Dimension Importance for Dense Information Retrieval.

[BibT_eX]

[DOI]

Proceedings of the 14th Italian Information Retrieval Workshop, 2024

A Quantum Annealing Instance Selection Approach for Efficient and Effective Transformer Fine-Tuning.

[BibT_eX]

[DOI]

Washington Cunha

Marcos André Gonçalves

Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, 2024

QuantumCLEF - Quantum Computing at CLEF.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2024

The CLEF 2024 Monster Track: One Lab to Rule Them All.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2024

Query Obfuscation for Information Retrieval Through Differential Privacy.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2024

Quantum Computing for Information Retrieval and Recommender Systems.

[BibT_eX]

[DOI]

Jose Manuel García Dominguez

Proceedings of the Advances in Information Retrieval, 2024

iDPP@CLEF 2024: The Intelligent Disease Progression Prediction Challenge.

[BibT_eX]

[DOI]

Sara C. Madeira

Eleonora Tavazzi

Proceedings of the Advances in Information Retrieval, 2024

Overview of QuantumCLEF 2024: The Quantum Computing Challenge for Information Retrieval and Recommender Systems at CLEF.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2024

QuantumCLEF 2024: Overview of the Quantum Computing Challenge for Information Retrieval and Recommender Systems at CLEF.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

SEUPD@CLEF: Team Axolotl on Rumor Verification using Evidence from Authorities.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

SEUPD@CLEF: Team IRIS on Temporal Evolution of Query Expansion and Rank Fusion Techniques Applied to Cross-Encoder Re-Rankers.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

What Happened in CLEF... For Another While?

[BibT_eX]

[DOI]

Francesco Luigi De Faveri

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2024

SEUPD@CLEF: Team MOUSE on Enhancing Search Engines Effectiveness with Large Language Models.

[BibT_eX]

[DOI]

Lorenzo Cazzador

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2024.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2024

Overview of iDPP@CLEF 2024: The Intelligent Disease Progression Prediction Challenge.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

SEUPD@CLEF: Team DAM on Reranking Using Sentence Embedders.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

SEUPD@CLEF: Team Kalu on improving Search Engine Performance with Query Expansion and Re-Ranking Approach.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), 2024

pyPANTERA: A Python PAckage for Natural language obfuscaTion Enforcing pRivacy & Anonymization.

[BibT_eX]

[DOI]

Francesco Luigi De Faveri

Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 2024

Evaluation of IR Systems.

[BibT_eX]

[DOI]

Proceedings of the Information Retrieval: Advanced Topics and Techniques., 2024

2023

Report on the 14th Conference and Labs of the Evaluation Forum (CLEF 2023): Experimental IR Meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

SIGIR Forum, December, 2023

iDPP@CLEF 2023 - Participants' repositories for the Intelligent Disease Prediction Progression Challenge.

[BibT_eX]

[DOI]

Dataset, November, 2023

Report on the 1st Workshop on Query Performance Prediction and Its Evaluation in New Tasks (QPP++ 2023) at ECIR 2023.

[BibT_eX]

[DOI]

SIGIR Forum, June, 2023

Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.

[BibT_eX]

[DOI]

SIGIR Forum, June, 2023

An in-depth investigation on the behavior of measures to quantify reproducibility.

[BibT_eX]

[DOI]

Inf. Process. Manag., May, 2023

Frontiers of Information Access Experimentation for Research and Education (Dagstuhl Seminar 23031).

[BibT_eX]

[DOI]

Dagstuhl Reports, January, 2023

Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education.

[BibT_eX]

[DOI]

CoRR, 2023

A Geometric Framework for Query Performance Prediction in Conversational Search.

[BibT_eX]

[DOI]

Cristina Ioana Muntean

Raffaele Perego

Nicola Tonellotto

Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023

DECAF: A Modular and Extensible Conversational Search Framework.

[BibT_eX]

[DOI]

Marco Alessio

Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023

On the Limitations of Query Performance Prediction for Neural IR.

[BibT_eX]

[DOI]

Proceedings of the 31st Symposium of Advanced Database Systems, 2023

A Modular Framework for Conversational Search Reproducible Experimentation.

[BibT_eX]

[DOI]

Marco Alessio

Proceedings of the 31st Symposium of Advanced Database Systems, 2023

SKET: an Unsupervised Knowledge Extraction Tool to Empower Digital Pathology Applications.

[BibT_eX]

[DOI]

Proceedings of the 19th The Conference on Information and Research science Connecting to Digital and Library science, 2023

A Spatial Approach to Predict Performance of Conversational Search Systems.

[BibT_eX]

[DOI]

Cristina Ioana Muntean

Raffaele Perego

Nicola Tonellotto

Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023), 2023

IR Systems Evaluation via Generalized Linear Models.

[BibT_eX]

[DOI]

Jose Manuel García Dominguez

Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023), 2023

Towards Query Performance Prediction for Neural Information Retrieval: Challenges and Opportunities.

[BibT_eX]

[DOI]

Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, 2023

QPP++ 2023: Query-Performance Prediction and Its Evaluation in New Tasks.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2023

Query Performance Prediction for Neural IR: Are We There Yet?

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2023

iDPP@CLEF 2023: The Intelligent Disease Progression Prediction Challenge.

[BibT_eX]

[DOI]

Sara C. Madeira

Eleonora Tavazzi

Proceedings of the Advances in Information Retrieval, 2023

qCLEF: A Proposal to Evaluate Quantum Annealing for Information Retrieval and Recommender Systems.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2023

DAVI: A Dataset for Automatic Variant Interpretation.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2023

Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2023.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2023

Overview of iDPP@CLEF 2023: The Intelligent Disease Progression Prediction Challenge.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team QEVALS on Information Retrieval Adapted to the Temporal Evolution of Web Documents.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team HIBALL on Incremental Information Retrieval System with RRF and BERT.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team DARDS - IR System for Short and Long Term Retrieval.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team Squid on LongEval-Retrieval.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team NEON. A Memoryless Approach To Longitudinal Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team FADERIC on A Query Expansion and Reranking Approach for the LongEval Task.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: RAFJAM on Longitudinal Evaluation of Model Performance.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team GWCA on Longitudinal Evaluation of IR Systems by Using Query Expansion and Learning To Rank.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUNIPD@CLEF: Team JIHUMING on Enhancing Search Engine Performance with Character N-Grams, Query Expansion, and Named Entity Recognition.

[BibT_eX]

[DOI]

Isil Atabek

Huimin Chen

Jesús Moncada-Ramírez

Nicolò Santini

Giovanni Zago

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

SEUPD@CLEF: Team CLOSE on Temporal Persistence of IR Systems' Performance.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), 2023

How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods.

[BibT_eX]

[DOI]

David Otero

Javier Parapar

Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023

Shared Tasks as Tutorials: A Methodical Approach.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Report on the 13th Conference and Labs of the Evaluation Forum (CLEF 2022): Experimental IR Meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

Alberto Barrón-Cedeño

Giovanni Da San Martino

SIGIR Forum, December, 2022

iDPP@CLEF 2022 - Participants' repositories for the Intelligent Disease Prediction Progression Challenge.

[BibT_eX]

[DOI]

Dataset, December, 2022

An in-depth Investigation on the Behaviour of Measures to Quantify Reproducibility.

[BibT_eX]

[DOI]

Dataset, January, 2022

Topic Difficulty: Collection and Query Formulation Effects.

[BibT_eX]

[DOI]

ACM Trans. Inf. Syst., 2022

sMARE: a new paradigm to evaluate and understand query performance prediction methods.

[BibT_eX]

[DOI]

Inf. Retr. J., 2022

Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales".

[BibT_eX]

[DOI]

CoRR, 2022

Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks.

[BibT_eX]

[DOI]

CoRR, 2022

How Do You Test a Test?: A Multifaceted Examination of Significance Tests.

[BibT_eX]

[DOI]

Proceedings of the WSDM '22: The Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event / Tempe, AZ, USA, February 21, 2022

Question Answering-Based Query Expansion for Conversational Search: IIIA@UNIPD at TREC CAsT 2022.

[BibT_eX]

[DOI]

Mattia Romanello

Proceedings of the Thirty-First Text REtrieval Conference, 2022

Towards Feature Selection for Ranking and Classification Exploiting Quantum Annealers.

[BibT_eX]

[DOI]

Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

Extracting a Unified Database from Heterogeneous Bills of Materials via Data Integration Approaches.

[BibT_eX]

[DOI]

Proceedings of the 30th Italian Symposium on Advanced Database Systems, 2022

Improving Conversational Evaluation via a Dependency-Aware Permutation Strategy.

[BibT_eX]

[DOI]

Proceedings of the 30th Italian Symposium on Advanced Database Systems, 2022

Evaluating the integration of datasets.

[BibT_eX]

[DOI]

Proceedings of the SAC '22: The 37th ACM/SIGAPP Symposium on Applied Computing, Virtual Event, April 25, 2022

Comparing ANOVA Approaches to Detect Significantly Different IR Systems.

[BibT_eX]

[DOI]

Proceedings of the 12th Italian Information Retrieval Workshop 2022, 2022

Feature Selection via Quantum Annealers for Ranking and Classification Tasks.

[BibT_eX]

[DOI]

Proceedings of the 12th Italian Information Retrieval Workshop 2022, 2022

A Dependency-Aware Utterances Permutation Strategy to Improve Conversational Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2022

Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2022.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2022

Overview of iDPP@CLEF 2022: The Intelligent Disease Progression Prediction Challenge.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

SEUPD@CLEF: Team hextech on Argument Retrieval for Comparative Questions. The importance of adjectives in documents quality evaluation.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

SEUPD@CLEF: Team 6musk on Argument Retrieval for Controversial Questions by Using Pairs Selection and Query Expansion.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

SEUPD@CLEF: Team Gamora on Argument Retrieval for Controversial Questions.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

SEUPD@CLEF: Team Lgtm on Argument Retrieval for Controversial Questions.

[BibT_eX]

[DOI]

Manuel Barusco

Gabriele Del Fiume

Riccardo Forzan

Mario Giovanni Peloso

Nicola Rizzetto

Elham Soleymani

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

SEUPD@CLEF: Team INTSEG on Argument Retrieval for Controversial Questions.

[BibT_eX]

[DOI]

Mohammad Muzammil Sohail

Paria Tahan

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

Aldo Nadi at Touché 2022: Argument Retrieval for Comparative Questions.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models.

[BibT_eX]

[DOI]

Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 2022

2021

Report on the 12th conference and labs of the evaluation forum (CLEF 2021): experimental IR meets multilinguality, multimodality, and interaction.

[BibT_eX]

[DOI]

SIGIR Forum, 2021

Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales.

[BibT_eX]

[DOI]

IEEE Access, 2021

Hierarchical Dependence-aware Evaluation Measures for Conversational Search.

[BibT_eX]

[DOI]

Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

sMARE: An Enhanced Query Performance Prediction Evaluation Approach (Discussion Paper).

[BibT_eX]

[DOI]

Proceedings of the 29th Italian Symposium on Advanced Database Systems, 2021

A Data Management and Anomaly Detection Solution for the Entertainment Industry (Discussion Paper).

[BibT_eX]

[DOI]

Proceedings of the 29th Italian Symposium on Advanced Database Systems, 2021

A Machine Learning-based Approach for Advanced Monitoring of Automated Equipment for the Entertainment Industry.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT, 2021

s-AWARE: Using Crowd Judgements in Supervised Measure-Based Methods for IR Evaluation.

[BibT_eX]

[DOI]

Luca Piazzon

Proceedings of the 17th Italian Research Conference on Digital Libraries, 2021

FullBrain: a Social E-learning Platform.

[BibT_eX]

[DOI]

Proceedings of the 17th Italian Research Conference on Digital Libraries, 2021

NoBis: A Crowd Monitoring Service Against COVID-19.

[BibT_eX]

[DOI]

Proceedings of the 17th Italian Research Conference on Digital Libraries, 2021

Do Hard Topics Exist? A Statistical Analysis.

[BibT_eX]

[DOI]

Proceedings of the 11th Italian Information Retrieval Workshop 2021, 2021

An Enhanced Evaluation Framework for Query Performance Prediction.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2021

System Effect Estimation by Sharding: A Comparison Between ANOVA Approaches to Detect Significant Differences.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2021

repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2021

2020

Report on CLEF 2020.

[BibT_eX]

[DOI]

SIGIR Forum, 2020

Boosting learning to rank with user dynamics and continuation methods.

[BibT_eX]

[DOI]

Inf. Retr. J., 2020

How do interval scales help us with better understanding IR evaluation measures?

[BibT_eX]

[DOI]

Eleonora Losiouk

Inf. Retr. J., 2020

How to Measure the Reproducibility of System-oriented IR Experiments.

[BibT_eX]

[DOI]

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Improving Learning to Rank By Leveraging User Dynamics and Continuation Methods.

[BibT_eX]

[DOI]

Proceedings of the 28th Italian Symposium on Advanced Database Systems, 2020

Reproducibility of the Neural Vector Space Model via Docker.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: The Era of Big Data and Data Science, 2020

Unsupervised Evaluation of Data Integration Processes.

[BibT_eX]

[DOI]

Proceedings of the iiWAS '20: The 22nd International Conference on Information Integration and Web-based Applications & Services, Virtual Event / Chiang Mai, Thailand, November 30, 2020

Exploiting Stopping Time to Evaluate Accumulated Relevance.

[BibT_eX]

[DOI]

Proceedings of the ICTIR '20: The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval, 2020

s-AWARE: Supervised Measure-Based Methods for Crowd-Assessors Combination.

[BibT_eX]

[DOI]

Luca Piazzon

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2020

2019

Using Collection Shards to Study Retrieval Performance Effect Sizes.

[BibT_eX]

[DOI]

Yubin Kim

ACM Trans. Inf. Syst., 2019

A General Theory of IR Evaluation Measures.

[BibT_eX]

[DOI]

IEEE Trans. Knowl. Data Eng., 2019

Report on CLEF 2019.

[BibT_eX]

[DOI]

Gundula Heinatz Bürki

SIGIR Forum, 2019

Report on ESSIR 2019: the 12th European Summer School in Information Retrieval.

[BibT_eX]

[DOI]

SIGIR Forum, 2019

Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019).

[BibT_eX]

[DOI]

Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019).

[BibT_eX]

[DOI]

Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

Improving the Accuracy of System Performance Estimation by Using Shards.

[BibT_eX]

[DOI]

Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

A Docker-Based Replicability Study of a Neural Information Retrieval Model.

[BibT_eX]

[DOI]

Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

A Formal Theory to Determine Scale Properties of Evaluation Measures.

[BibT_eX]

[DOI]

Proceedings of the 27th Italian Symposium on Advanced Database Systems, 2019

Scales of Evaluation Measures: From Theory to Experimentation.

[BibT_eX]

[DOI]

Proceedings of the 10th Italian Information Retrieval Workshop, 2019

EVIA 2019 Preface.

[BibT_eX]

[DOI]

Ian Soboroff

Min Zhang

Proceedings of the 9th International Workshop on Evaluating Information Access co-located with the 14th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2019), 2019

CENTRE@CLEF 2019.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2019

Stochastic Relevance for Crowdsourcing.

[BibT_eX]

[DOI]

Eleonora Losiouk

Proceedings of the Advances in Information Retrieval, 2019

A Markovian Approach to Evaluate Session-Based IR Systems.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2019

Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2019

What Happened in CLEF \ldots For a While?

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2019

CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2019, 2019

An Innovative Approach to Data Management and Curation of Experimental Data Generated Through IR Test Collections.

[BibT_eX]

[DOI]

Proceedings of the Information Retrieval Evaluation in a Changing World, 2019

Visual Analytics and IR Experimental Evaluation.

[BibT_eX]

[DOI]

Giuseppe Santucci

Proceedings of the Information Retrieval Evaluation in a Changing World, 2019

From Multilingual to Multimodal: The Evolution of CLEF over Two Decades.

[BibT_eX]

[DOI]

Proceedings of the Information Retrieval Evaluation in a Changing World, 2019

2018

Report on GLARE 2018: 1st Workshop on Generalization in Information Retrieval.

[BibT_eX]

[DOI]

Ian Soboroff

SIGIR Forum, 2018

Report on EVIA 2017.

[BibT_eX]

[DOI]

Ian Soboroff

SIGIR Forum, 2018

The Dagstuhl Perspectives Workshop on Performance Modeling and Prediction.

[BibT_eX]

[DOI]

SIGIR Forum, 2018

SIGIR Initiative to Implement ACM Artifact Review and Badging.

[BibT_eX]

[DOI]

Diane Kelly

SIGIR Forum, 2018

Report on CLEF 2018: Experimental IR Meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

SIGIR Forum, 2018

Introduction to the Special Issue on Reproducibility in Information Retrieval: Tools and Infrastructures.

[BibT_eX]

[DOI]

Andreas Rauber

ACM J. Data Inf. Qual., 2018

Introduction to the Special Issue on Reproducibility in Information Retrieval: Evaluation Campaigns, Collections, and Analyses.

[BibT_eX]

[DOI]

Andreas Rauber

ACM J. Data Inf. Qual., 2018

Toward an anatomy of IR system component performances.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2018

CLAIRE: A combinatorial visual analytics system for information retrieval evaluation.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2018

From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442).

[BibT_eX]

[DOI]

Dagstuhl Manifestos, 2018

Graph Databases Benchmarking on the Italian Business Register.

[BibT_eX]

[DOI]

Luca Sinico

Proceedings of the 26th Italian Symposium on Advanced Database Systems, 2018

How to Robustly Combine Judgements from Crowd Assessors with AWARE.

[BibT_eX]

[DOI]

Proceedings of the 26th Italian Symposium on Advanced Database Systems, 2018

Evaluation of Conformance Checkers for Long-Term Preservation of Multimedia Documents.

[BibT_eX]

[DOI]

Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries, 2018

Thirty Years of Digital Libraries Research at the University of Padua: The Systems Side.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Multimedia Archives, 2018

Thirty Years of Digital Libraries Research at the University of Padua: The User Side.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Multimedia Archives, 2018

How Topic and System Size Affect the Correlation among Evaluation Measures.

[BibT_eX]

[DOI]

Proceedings of the 9th Italian Information Retrieval Workshop, 2018

The CLAIRE Visual Analytics System for Analysing IR Evaluation Data.

[BibT_eX]

[DOI]

Proceedings of the 9th Italian Information Retrieval Workshop, 2018

Modelling Randomness in Relevance Judgments and Evaluation Measures.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2018

Overview of CENTRE@CLEF 2018: A First Tale in the Systematic Reproducibility Realm.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2018

CENTRE@CLEF2018: Overview of the Replicability Task.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2018, 2018

Continuation Methods and Curriculum Learning for Learning to Rank.

[BibT_eX]

[DOI]

Proceedings of the 27th ACM International Conference on Information and Knowledge Management, 2018

Digital Libraries: From Digital Resources to Challenges in Scientific Data Sharing and Re-Use.

[BibT_eX]

[DOI]

Proceedings of the A Comprehensive Guide Through the Italian Database Research Over the Last 25 Years., 2018

2017

What Does Affect the Correlation Among Evaluation Measures?

[BibT_eX]

[DOI]

ACM Trans. Inf. Syst., 2017

AWARE: Exploiting Evaluation Measures to Combine Multiple Assessors.

[BibT_eX]

[DOI]

ACM Trans. Inf. Syst., 2017

Report on LEARNER 2017: 1st International Workshop on LEARning Next gEneration Rankers.

[BibT_eX]

[DOI]

SIGIR Forum, 2017

Report on CLEF 2017: Experimental IR Meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

SIGIR Forum, 2017

Overview of Special Issue.

[BibT_eX]

[DOI]

SIGIR Forum, 2017

Semantic representation and enrichment of information retrieval experimental data.

[BibT_eX]

[DOI]

Int. J. Digit. Libr., 2017

Reproducibility Challenges in Information Retrieval Evaluation.

[BibT_eX]

[DOI]

ACM J. Data Inf. Qual., 2017

3.5K runs, 5K topics, 3M assessments and 70M measures: What trends in 10 years of Adhoc-ish CLEF?

[BibT_eX]

[DOI]

Inf. Process. Manag., 2017

Towards Performance Modeling and Performance Prediction across IR/RecSys/NLP (Dagstuhl Perspectives Workshop 17442).

[BibT_eX]

[DOI]

Dagstuhl Reports, 2017

Visual Analytics for Information Retrieval Evaluation Campaigns.

[BibT_eX]

[DOI]

Proceedings of the 8th International EuroVis Workshop on Visual Analytics, 2017

IMS @ TREC 2017 Core Track.

[BibT_eX]

[DOI]

Proceedings of The Twenty-Sixth Text REtrieval Conference, 2017

Sub-corpora Impact on System Effectiveness.

[BibT_eX]

[DOI]

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

On Including the User Dynamic in Learning to Rank.

[BibT_eX]

[DOI]

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

Keyword-based access to relational data: To reproduce, or to not reproduce?

[BibT_eX]

[DOI]

Proceedings of the 25th Italian Symposium on Advanced Database Systems, 2017

An Interval-Like Scale Property for I. R. Evaluation Measures.

[BibT_eX]

[DOI]

Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), 2017

CLEF 2018: Evaluation Labs, Conference, and Initiative.

[BibT_eX]

[DOI]

Proceedings of the 13th NTCIR Conference, 2017

The Road Towards Reproducibility in Science: The Case of Data Citation.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Archives, 2017

Component-Based Evaluation Using GLMM.

[BibT_eX]

[DOI]

Proceedings of the 8th Italian Information Retrieval Workshop, 2017

A Software Library for Conducting Large Scale Experiments on Learning to Rank Algorithms.

[BibT_eX]

[DOI]

Paolo Picello

Proceedings of the 1st International Workshop on LEARning Next gEneration Rankers co-located with the 3rd ACM International Conference on the Theory of Information Retrieval (ICTIR 2017), 2017

LEARning Next gEneration Rankers (LEARNER 2017).

[BibT_eX]

[DOI]

Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, 2017

Are IR Evaluation Measures on an Interval Scale?

[BibT_eX]

[DOI]

Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, 2017

Towards Open-Source Shared Implementations of Keyword-Based Access Systems to Relational Data.

[BibT_eX]

[DOI]

Proceedings of the Workshops of the EDBT/ICDT 2017 Joint Conference (EDBT/ICDT 2017), 2017

2016

"Data Citation is Coming". Introduction to the Special Issue on Data Citation.

[BibT_eX]

[DOI]

Bull. IEEE Tech. Comm. Digit. Libr., 2016

Keyword-Based Search Over Databases: A Roadmap for a Reference Architecture Paired with an Evaluation Framework.

[BibT_eX]

[DOI]

Trans. Comput. Collect. Intell., 2016

Increasing Reproducibility in IR: Findings from the Dagstuhl Seminar on "Reproducibility of Data-Oriented Experiments in e-Science".

[BibT_eX]

[DOI]

SIGIR Forum, 2016

Report on ECIR 2016: 38th European Conference on Information Retrieval.

[BibT_eX]

[DOI]

SIGIR Forum, 2016

The twist measure for IR evaluation: Taking user's effort into account.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2016

Descendants, ancestors, children and parent: A set-based approach to efficiently address XPath primitives.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2016

Digital library interoperability at high level of abstraction.

[BibT_eX]

[DOI]

Future Gener. Comput. Syst., 2016

A General Linear Mixed Models Approach to Study System Component Effects.

[BibT_eX]

[DOI]

Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016

A Visual Analytics Approach for What-If Analysis of Information Retrieval Systems.

[BibT_eX]

[DOI]

Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016

Fast Access to XML Data: A Set-Based Approach.

[BibT_eX]

Proceedings of the 24th Italian Symposium on Advanced Database Systems, 2016

From Users to Systems: Identifying and Overcoming Barriers to Efficiently Access Archival Data.

[BibT_eX]

[DOI]

Proceedings of the First International Workshop on Accessing Cultural Heritage at Scale co-located with Joint Conference on Digital Libraries 2016 (JCDL 2016), 2016

Proposal for an Evaluation Framework for Compliance Checkers for Long-Term Digital Preservation.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Multimedia Archives, 2016

An Ontology to Make the DELOS Reference Model and the 5S Model Interoperable.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Multimedia Archives, 2016

Basis of a Formal Framework for Information Retrieval Evaluation Measurements.

[BibT_eX]

[DOI]

Proceedings of the 7th Italian Information Retrieval Workshop, 2016

What-If Analysis: A Visual Analytics Approach to Information Retrieval Evaluation.

[BibT_eX]

[DOI]

Proceedings of the 7th Italian Information Retrieval Workshop, 2016

IR Scientific Data: How to Semantically Represent and Enrich Them.

[BibT_eX]

[DOI]

Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) & Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016), 2016

The CLEF Monolingual Grid of Points.

[BibT_eX]

[DOI]

Proceedings of the Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2016

System And User Centered Evaluation Approaches in Interactive Information Retrieval (SAUCE 2016).

[BibT_eX]

[DOI]

Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, 2016

2015

1st International Workshop on Multilingual Web Access (MWA 2015).

[BibT_eX]

[DOI]

SIGIR Forum, 2015

Report on CLEF 2015: Experimental IR Meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

Karen Pinel-Sauvagnat

Eric SanJuan

Jacques Savoy

SIGIR Forum, 2015

A Perspective Look at Keyword-based Search Over Relation Data and its Evaluation (extended abstract).

[BibT_eX]

Proceedings of the 23rd Italian Symposium on Advanced Database Systems, 2015

Towards a Semantic Web Enabled Representation of DL Foundational Models: The Quality Domain Example.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries on the Move, 2015

The PREFORMA Project: Federating Memory Institutions for Better Compliance of Preservation Formats.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries on the Move, 2015

CLEF 2000-2014: Lessons Learnt from Ad Hoc Retrieval.

[BibT_eX]

[DOI]

Proceedings of the 6th Italian Information Retrieval Workshop, 2015

Markov Precision: Modelling User Behaviour over Rank and Time.

[BibT_eX]

[DOI]

Proceedings of the 6th Italian Information Retrieval Workshop, 2015

Towards a Formal Framework for Utility-oriented Measurements of Retrieval Effectiveness.

[BibT_eX]

[DOI]

Proceedings of the 2015 International Conference on The Theory of Information Retrieval, 2015

Rank-Biased Precision Reloaded: Reproducibility and Generalization.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2015

Visual Analytics for Information Retrieval Evaluation (VAIRË 2015).

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2015

2014

VIRTUE: A visual tool for information retrieval performance evaluation and failure analysis.

[BibT_eX]

[DOI]

J. Vis. Lang. Comput., 2014

CLEF 15th Birthday: Past, Present, and Future.

[BibT_eX]

[DOI]

SIGIR Forum, 2014

CLEF 2014: Information Access Evaluation meets Multilinguality, Multimodality, and Interaction.

[BibT_eX]

[DOI]

SIGIR Forum, 2014

Making it Easier to Discover, Re-Use and Understand Search Engine Experimental Evaluation Data.

[BibT_eX]

[DOI]

ERCIM News, 2014

Injecting user models and time into precision via Markov chains.

[BibT_eX]

[DOI]

Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

Enriching Digital Cultural Heritage Collections via Annotations: The CULTURA approach.

[BibT_eX]

Proceedings of the 22nd Italian Symposium on Advanced Database Systems, 2014

Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives.

[BibT_eX]

[DOI]

Proceedings of the Pushing the Boundaries of the Digital Libraries Field, 2014

CULTURA Outcomes for Improving the User's Engagement with Cultural Heritage Collections.

[BibT_eX]

[DOI]

Proceedings of the Pushing the Boundaries of the Digital Libraries Field, 2014

A Visual Interactive Environment for Making Sense of Experimental Data.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2014

CLEF 15th Birthday: What Can We Learn From Ad Hoc Retrieval?

[BibT_eX]

[DOI]

Proceedings of the Information Access Evaluation. Multilinguality, Multimodality, and Interaction, 2014

Rethinking How to Extend Average Precision to Graded Relevance.

[BibT_eX]

[DOI]

Proceedings of the Information Access Evaluation. Multilinguality, Multimodality, and Interaction, 2014

Preface.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2014 Conference, 2014

2013

PROMISE technology transfer day: spreading the word on information access evaluation at an industrial event.

[BibT_eX]

[DOI]

SIGIR Forum, 2013

CLEF 2013: information access evaluation meets multilinguality, multimodality, and visualization.

[BibT_eX]

[DOI]

SIGIR Forum, 2013

PROMISE winter school 2013 bridging between information retrieval and databases.

[BibT_eX]

[DOI]

SIGIR Forum, 2013

NESTOR: A formal model for digital archives.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2013

Keyword search and evaluation over relational databases: an outlook to the future.

[BibT_eX]

[DOI]

Proceedings of the 7th International Workshop on Ranking in Databases (co-located with VLDB 2013), 2013

Refactoring Database to Improve Queries Performance.

[BibT_eX]

Proceedings of the 21st Italian Symposium on Advanced Database Systems, 2013

Digital Archives: Extending the 5S Model through NESTOR.

[BibT_eX]

[DOI]

Proceedings of the Bridging Between Cultural Heritage Institutions, 2013

Fostering Interaction with Cultural Heritage Material via Annotations: The FAST-CAT Way.

[BibT_eX]

[DOI]

Proceedings of the Bridging Between Cultural Heritage Institutions, 2013

Cumulated Relative Position: A Metric for Ranking Evaluation.

[BibT_eX]

[DOI]

Proceedings of the 4th Italian Information Retrieval Workshop, 2013

Formal Models for Digital Archives: NESTOR and the 5S.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2013

Interacting with digital cultural heritage collections via annotations: the CULTURA approach.

[BibT_eX]

[DOI]

Proceedings of the ACM Symposium on Document Engineering 2013, 2013

The FAST-CAT: Empowering Cultural Heritage Annotations.

[BibT_eX]

[DOI]

Proceedings of the 8th Annual International Conference of the Alliance of Digital Humanities Organizations, 2013

Cultural Heritage in CLEF (CHiC) 2013.

[BibT_eX]

[DOI]

Proceedings of the Information Access Evaluation. Multilinguality, Multimodality, and Visualization, 2013

Cultural Heritage in CLEF (CHiC) 2013 - Multilingual Task Overview.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2013 Conference , 2013

Improving Ranking Evaluation Employing Visual Analytics.

[BibT_eX]

[DOI]

Proceedings of the Information Access Evaluation. Multilinguality, Multimodality, and Visualization, 2013

2012

PROMISE retreat report prospects and opportunities for information access evaluation.

[BibT_eX]

[DOI]

SIGIR Forum, 2012

CLEF 2012: information access evaluation meets multilinguality, multimodality, and visual analytics.

[BibT_eX]

[DOI]

SIGIR Forum, 2012

DESIRE 2011: workshop on data infrastructurEs for supporting information retrieval evaluation.

[BibT_eX]

[DOI]

Costantino Thanos

SIGIR Forum, 2012

PROMISE winter school 2012 information retrieval meets information visualization.

[BibT_eX]

[DOI]

SIGIR Forum, 2012

Modeling Archives by Means of OAI-ORE.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Archives - 8th Italian Research Conference, 2012

Empowering Archives through Annotations.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Archives - 8th Italian Research Conference, 2012

Visual interactive failure analysis: supporting users in information retrieval evaluation.

[BibT_eX]

[DOI]

Proceedings of the Information Interaction in Context: 2012, 2012

Information retrieval failure analysis: Visual analytics as a support for interactive "what-if" investigation.

[BibT_eX]

[DOI]

Proceedings of the 7th IEEE Conference on Visual Analytics Science and Technology, 2012

Cultural Heritage in CLEF (CHiC) Overview 2012.

[BibT_eX]

[DOI]

Proceedings of the CLEF 2012 Evaluation Labs and Workshop, 2012

DIRECTions: Design and Specification of an IR Evaluation Infrastructure.

[BibT_eX]

[DOI]

Proceedings of the Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics, 2012

2011

Handling Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries.

[BibT_eX]

[DOI]

Proceedings of the Learning Structure and Schemas from Documents, 2011

CLEF 2011: conference on multilingual and multimodal information access evaluation.

[BibT_eX]

[DOI]

SIGIR Forum, 2011

Harnessing the Scientific Data Produced by the Experimental Evaluation Search Engines and Information Access Systems.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Computational Science, 2011

DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation.

[BibT_eX]

[DOI]

ERCIM News, 2011

The NESTOR Model: Properties and Applications in the Context of Digital Archives.

[BibT_eX]

Proceedings of the Sistemi Evoluti per Basi di Dati, 2011

Reports from Other Evaluation Campaigns and Panel Discussion: TREC is 20 Years Old, Where Now for Evaluation Campaigns?

[BibT_eX]

[DOI]

Proceedings of the 4th International Workshop on Evaluating Information Access, 2011

EuropeanaConnect.

[BibT_eX]

[DOI]

Franco Crivellari

Graziano Deambrosis

Proceedings of the Digital Libraries and Archives - 7th Italian Research Conference, 2011

PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Archives - 7th Italian Research Conference, 2011

SIAR: A User-Centric Digital Archive System.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries and Archives - 7th Italian Research Conference, 2011

Experimental evaluation and hypertexts.

[BibT_eX]

[DOI]

Proceedings of the First Workshop on Personalised Multilingual Hypertext Retrieval, 2011

Visual Comparison of Ranked Result Cumulated Gains.

[BibT_eX]

[DOI]

Proceedings of the 2nd International EuroVis Workshop on Visual Analytics, 2011

Interactive Analysis and Exploration of Experimental Evaluation Results.

[BibT_eX]

[DOI]

Proceedings of the 1st European Workshop on Human-Computer Interaction and Information Retrieval, 2011

CHiC 2011 - Cultural Heritage in CLEF: From Use Cases to Evaluation in Practice for Multilingual Information Access to Cultural Heritage.

[BibT_eX]

[DOI]

Maria Gäde

Monica Lestari Paramita

Proceedings of the CLEF 2011 Labs and Workshop, 2011

To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma?

[BibT_eX]

[DOI]

Proceedings of the Multilingual and Multimodal Information Access Evaluation, 2011

DESIRE 2011: first international workshop on data infrastructures for supporting information retrieval evaluation.

[BibT_eX]

[DOI]

Costantino Thanos

Proceedings of the 20th ACM Conference on Information and Knowledge Management, 2011

2010

CLEF 2010 conference on multilingual and multimodal information access evaluation.

[BibT_eX]

[DOI]

SIGIR Forum, 2010

The NESTOR Framework: Manage, Access and Exchange Hierarchical DataStructures.

[BibT_eX]

Proceedings of the Eighteenth Italian Symposium on Advanced Database Systems, 2010

CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum.

[BibT_eX]

[DOI]

Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, 2010

10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go.

[BibT_eX]

[DOI]

Proceedings of the 3rd International Workshop on Evaluating Information Access, 2010

FAST and NESTOR: How to Exploit Annotation Hierarchies.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries - 6th Italian Research Conference, 2010

A PROMISE for Experimental Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Multilingual and Multimodal Information Access Evaluation, 2010

2009

The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns.

[BibT_eX]

[DOI]

Bull. IEEE Tech. Comm. Digit. Libr., 2009

DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns.

[BibT_eX]

[DOI]

Bull. IEEE Tech. Comm. Digit. Libr., 2009

Access and Exchange of Hierarchically Structured Resources on the Web with the NESTOR Framework.

[BibT_eX]

[DOI]

Proceedings of the 2009 IEEE/WIC/ACM International Conference on Web Intelligence, 2009

The FAST Annotation Service.

[BibT_eX]

Proceedings of the Seventeenth Italian Symposium on Advanced Database Systems, 2009

Design and Development of the Data Model of a Distributed DLS Architecture for Archive Metadata.

[BibT_eX]

[DOI]

Proceedings of the Post-proceedings of the Fifth Italian Research Conference on Digital Libraries, 2009

CLEF Ad-hoc: A Perspective on the Evolution of the Cross-Language Evaluation Forum.

[BibT_eX]

[DOI]

Proceedings of the Post-proceedings of the Fifth Italian Research Conference on Digital Libraries, 2009

Design of an Information Retrieval System Based on the Peer-to-Peer Paradigm: An Application to Music Retrieval.

[BibT_eX]

[DOI]

Proceedings of the Post-proceedings of the Fifth Italian Research Conference on Digital Libraries, 2009

The NESTOR Framework: How to Handle Hierarchical Data Structures.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2009

Annotation Search: The FAST Way.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2009

Managing the Knowledge Creation Process of Large-Scale Evaluation Campaigns.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2009

CLEF 2009 Ad Hoc Track Overview: TEL and Persian Tasks.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2009 Workshop co-located with the 13th European Conference on Digital Libraries (ECDL 2009) , Corfù, Greece, September 30, 2009

Grid@CLEF 2009 Track Overview.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2009 Workshop co-located with the 13th European Conference on Digital Libraries (ECDL 2009) , Corfù, Greece, September 30, 2009

CLEF 2009: Grid@CLEF Pilot Track Overview.

[BibT_eX]

[DOI]

Proceedings of the Multilingual Information Access Evaluation I. Text Retrieval Experiments, 2009

2008

Towards a Superimposed Peer Infrastructure for iNformation Access.

[BibT_eX]

Emanuele Di Buccio

Proceedings of the Sixteenth Italian Symposium on Advanced Database Systems, 2008

How robust are multilingual information retrieval systems?

[BibT_eX]

[DOI]

Proceedings of the 2008 ACM Symposium on Applied Computing (SAC), 2008

From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum.

[BibT_eX]

[DOI]

Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, 2008

From Research to Application in Multilingual Information Access: the Contribution of Evaluation.

[BibT_eX]

[DOI]

Martin Braschler

Julio Gonzalo

Proceedings of the International Conference on Language Resources and Evaluation, 2008

An Evaluation Resource for Geographic Information Retrieval.

[BibT_eX]

[DOI]

Fredric C. Gey

Diana Santos

Proceedings of the International Conference on Language Resources and Evaluation, 2008

A Distributed Digital Library System Architecture for Archive Metadata.

[BibT_eX]

Proceedings of the Post-proceedings of the Forth Italian Research Conference on Digital Library Systems, 2008

Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF.

[BibT_eX]

Proceedings of the Post-proceedings of the Forth Italian Research Conference on Digital Library Systems, 2008

The Design of the User Interface of a Scientific DLS in the Context of the Data, Information, Knowledge, and Wisdom Hierarchy.

[BibT_eX]

Proceedings of the Post-proceedings of the Forth Italian Research Conference on Digital Library Systems, 2008

Content-based Information Retrieval in SPINA.

[BibT_eX]

Emanuele Di Buccio

Proceedings of the Post-proceedings of the Forth Italian Research Conference on Digital Library Systems, 2008

A Methodology for Sharing Archival Descriptive Metadata in a Distributed Environment.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2008

Design of a Digital Library System for Large-Scale Evaluation Campaigns.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2008

Annotations: A Way to Interoperability in DL.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2008

Workshop on Novel Methodologies for Evaluation in Information Retrieval.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval , 2008

CLEF 2008: Ad Hoc Track Overview.

[BibT_eX]

[DOI]

Eneko Agirre

Proceedings of the Working Notes for CLEF 2008 Workshop co-located with the 12th European Conference on Digital Libraries (ECDL 2008) , 2008

A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval.

[BibT_eX]

[DOI]

Franco Crivellari

Proceedings of the Information Access through Search Engines and Digital Libraries, 2008

Digital Annotations: a Formal Model and its Applications.

[BibT_eX]

[DOI]

Proceedings of the Information Access through Search Engines and Digital Libraries, 2008

2007

A formal model of annotations of digital content.

[BibT_eX]

[DOI]

ACM Trans. Inf. Syst., 2007

A historical and contemporary study on annotations to derive key features for systems design.

[BibT_eX]

[DOI]

Giorgetta Bonfiglio-Dosio

Int. J. Digit. Libr., 2007

Distributed Information Retrieval and Automatic Identification of Music Works in SAPIR.

[BibT_eX]

Emanuele Di Buccio

Proceedings of the Fifteenth Italian Symposium on Advanced Database Systems, 2007

Challenges to Evaluation of Multilingual Geographic Information Retrieval in GeoCLEF.

[BibT_eX]

[DOI]

Diana Santos

Paulo Rocha

Andrés Montoyo

Proceedings of the 1st International Workshop on Evaluating Information Access, 2007

CLEF: Ongoing Activities and Plans for the Future.

[BibT_eX]

[DOI]

Proceedings of the 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, 2007

A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns.

[BibT_eX]

[DOI]

Proceedings of the 1st International Workshop on Evaluating Information Access, 2007

Annotation: what we learned from DELOS.

[BibT_eX]

Proceedings of the Post-proceedings of the Third Italian Research Conference on Digital Library Systems, 2007

An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation.

[BibT_eX]

Proceedings of the Post-proceedings of the Third Italian Research Conference on Digital Library Systems, 2007

Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries.

[BibT_eX]

Tullio Coppotelli

Proceedings of the Post-proceedings of the Third Italian Research Conference on Digital Library Systems, 2007

Extending the DelosDLMS by the FAST Annotation Service.

[BibT_eX]

Proceedings of the Post-proceedings of the Third Italian Research Conference on Digital Library Systems, 2007

Annotations and Digital Libraries: Designing Adequate Test-Beds.

[BibT_eX]

[DOI]

Proceedings of the Asian Digital Libraries. Looking Back 10 Years and Forging New Frontiers, 2007

The Future of Large-Scale Evaluation Campaigns for Information Retrieval in Europe.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2007

Roadmap for MultiLingual Information Access in the European Library.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2007

How to Compare Bilingual to Monolingual Cross-Language Information Retrieval.

[BibT_eX]

[DOI]

Franco Crivellari

Proceedings of the Advances in Information Retrieval, 2007

Adding Multilingual Information Access to the European Library.

[BibT_eX]

[DOI]

Martin Braschler

Proceedings of the Digital Libraries: Research and Development, 2007

The Importance of Scientific Data Curation for Evaluation Campaigns.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: Research and Development, 2007

An Architecture for Sharing Metadata Among Geographically Distributed Archives.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: Research and Development, 2007

An Approach for the Construction of an Experimental Test Collection to Evaluate Search Systems that Exploit Annotations.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: Research and Development, 2007

DelosDLMS - The Integrated DELOS Digital Library Management System.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: Research and Development, 2007

CLEF 2007: Ad Hoc Track Overview.

[BibT_eX]

[DOI]

Proceedings of the Advances in Multilingual and Multimodal Information Retrieval, 2007

GeoCLEF 2007: The CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview.

[BibT_eX]

[DOI]

Fredric C. Gey

Xing Xie

Proceedings of the Advances in Multilingual and Multimodal Information Retrieval, 2007

Annotations as a Tool for Disclosing Hidden Relationships Between Illuminated Manuscripts.

[BibT_eX]

[DOI]

Proceedings of the AI*IA 2007: Artificial Intelligence and Human-Oriented Computing, 2007

2006

Graph-based automatic suggestion of relationships among images of illuminated manuscripts.

[BibT_eX]

[DOI]

Proceedings of the 2006 ACM Symposium on Applied Computing (SAC), 2006

Uniform Methodology for Evaluating Information Access Components of Digital Libraries.

[BibT_eX]

Proceedings of the Post-proceedings of the Second Italian Research Conference on Digital Library Management Systems (IRCDL 2006), 2006

Search Strategies for Finding Annotations and Annotated Documents: The FAST Service.

[BibT_eX]

[DOI]

Proceedings of the Flexible Query Answering Systems, 7th International Conference, 2006

Scientific Evaluation of a DLMS: A Service for Evaluating Information Access Components.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2006

CLEF 2006: Ad Hoc Track Overview.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2006 Workshop co-located with the 10th European Conference on Digital Libraries (ECDL 2006), 2006

GeoCLEF 2006: The CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview.

[BibT_eX]

[DOI]

Diana Santos

Paulo Rocha

Proceedings of the Evaluation of Multilingual and Multi-modal Information Retrieval, 2006

Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them?

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2006 Workshop co-located with the 10th European Conference on Digital Libraries (ECDL 2006), 2006

Annotation as a support to user interaction for content enhancement in digital libraries.

[BibT_eX]

[DOI]

Proceedings of the working conference on Advanced visual interfaces, 2006

2005

A probabilistic model for stemmer generation.

[BibT_eX]

[DOI]

Michela Bacchin

Inf. Process. Manag., 2005

Annotating illuminated manuscripts: an effective tool for research and education.

[BibT_eX]

[DOI]

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, 2005

DiLAS: a Digital Library Annotation Service.

[BibT_eX]

Annelise Mark Pejtersen

Ulrich Thiel

Proceedings of the International Workshop on Annotation for Collaboration, 2005

DIRECT: A System for Evaluating Information Access Components of Digital Libraries.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2005

Annotations as Context for Searching Documents.

[BibT_eX]

[DOI]

Proceedings of the Context: Nature, Impact, and Role, 2005

CLEF 2005: Ad Hoc Track Overview.

[BibT_eX]

[DOI]

Gareth J. F. Jones

Proceedings of the Working Notes for CLEF 2005 Workshop co-located with the 9th European Conference on Digital Libraries (ECDL 2005), 2005

2004

Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2004

A System Architecture as a Support to a Flexible Annotation Service.

[BibT_eX]

[DOI]

Proceedings of the Peer-to-Peer, 2004

An Information Service Architecture for Annotations.

[BibT_eX]

Proceedings of the Digital Library Architectures: Peer-to-Peer, 2004

Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources.

[BibT_eX]

[DOI]

Proceedings of the Multilingual Information Access for Text, 2004

The University of Padua at CLEF 2004: Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2004 Workshop co-located with the 8th European Conference on Digital Libraries (ECDL 2004), 2004

CLEF 2004: Ad Hoc Track Overview and Results Analysis.

[BibT_eX]

[DOI]

Martin Braschler

Proceedings of the Multilingual Information Access for Text, 2004

2003

Annotations: Enriching a Digital Library.

[BibT_eX]

[DOI]

Proceedings of the Research and Advanced Technology for Digital Libraries, 2003

The University of Padova at CLEF 2003: Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation.

[BibT_eX]

[DOI]

Proceedings of the Working Notes for CLEF 2003 Workshop co-located with the 7th European Conference on Digital Libraries (ECDL 2003), 2003

Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation.

[BibT_eX]

[DOI]

Proceedings of the Comparative Evaluation of Multilingual Information Access Systems, 2003

2002

The Effectiveness of a Graph-Based Algorithm for Stemming.

[BibT_eX]

[DOI]

Michela Bacchin

Proceedings of the Digital Libraries: People, 2002

University of Padua at CLEF 2002: Experiments to Evaluate a Statistical Stemming Algorithm.

[BibT_eX]

[DOI]

Michela Bacchin