Stefano Mizzaro

Damiano Spina

Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

The Effects of Crowd Worker Biases in Fact-Checking Tasks.

[BibT_eX]

[DOI]

Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

BUM at CheckThat!-2022: A Composite Deep Learning Approach to Fake News Detection using Evidence Retrieval.

[BibT_eX]

[DOI]

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

When Truncated Rankings Are Better and How to Measure That - Abstract.

[BibT_eX]

[DOI]

Damiano Spina

Proceedings of the 2nd Joint Conference of the Information Retrieval Communities in Europe (CIRCLE 2022), 2022

Causal Text-to-Text Transformers for Water Pollution Forecasting.

[BibT_eX]

[DOI]

Proceedings of the 2nd Italian Workshop on Artificial Intelligence and Applications for Business and Industries (AIABI 2022) co-located with 21st International Conference of the Italian Association for Artificial Intelligence (AI*IA 2022), 2022

A Hybrid Human-In-The-Loop Framework for Fact Checking.

[BibT_eX]

[DOI]

David La Barbera

Proceedings of the Sixth Workshop on Natural Language for Artificial Intelligence (NL4AI 2022) co-located with 21th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2022), 2022

2021

The many dimensions of truthfulness: Crowdsourcing misinformation assessments on a multidimensional scale.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2021

On the effect of relevance scales in crowdsourcing relevance assessments for Information Retrieval evaluation.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2021

Managing Bias in Human-Annotated Data: Moving Beyond Bias Removal.

[BibT_eX]

[DOI]

Gianluca Demartini

CoRR, 2021

Human-in-the-Loop Systems for Truthfulness: A Study of Human and Machine Confidence.

[BibT_eX]

[DOI]

Proceedings of the 2021 Truth and Trust Online Conference (TTO 2021), 2021

A Software Simulator for Optimizing Ambulance Location and Response Time: A Preliminary Report.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Digital Health, 2021

2020

Fewer topics? A million topics? Both?! On topics subsets in test collections.

[BibT_eX]

[DOI]

Inf. Retr. J., 2020

On the nature of information access evaluation metrics: a unifying framework.

[BibT_eX]

[DOI]

Inf. Retr. J., 2020

Axiomatic thinking for information retrieval: introduction to special issue.

[BibT_eX]

[DOI]

Inf. Retr. J., 2020

Effectiveness evaluation without human relevance judgments: A systematic analysis of existing methods and of their combinations.

[BibT_eX]

[DOI]

Inf. Process. Manag., 2020

Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities.

[BibT_eX]

[DOI]

Gianluca Demartini

Damiano Spina

IEEE Data Eng. Bull., 2020

Can The Crowd Identify Misinformation Objectively?: The Effects of Judgment Scale and Assessor's Background.

[BibT_eX]

[DOI]

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Twitter goes to the Doctor: Detecting Medical Tweets using Machine Learning and BERT.

[BibT_eX]

[DOI]

Proceedings of the Workshop on Semantic Indexing and Information Retrieval for Health from heterogeneous content types and languages co-located with 42nd European Conference on Information Retrieval, 2020

Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2020

The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?

[BibT_eX]

[DOI]

Proceedings of the CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, 2020

An Effectiveness Metric for Ordinal Classification: Formal Properties and Experimental Results.

[BibT_eX]

[DOI]

Julio Gonzalo

Jorge Carrillo-de-Albornoz

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Mobile Search Behaviors: An In-Depth Analysis Based on Contexts, APPs, and Devices. Dan Wu and Shaobo Liang. Synthesis Lectures on Information Concepts, Retrieval, and Services. San Rafael, CA: Morgan & Claypool, 2018.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2019

Mobile Information Retrieval.

[BibT_eX]

[DOI]

CoRR, 2019

On Topic Difficulty in IR Evaluation: The Effect of Systems, Corpora, and System Components.

[BibT_eX]

[DOI]

Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysis.

[BibT_eX]

[DOI]

Proceedings of the 4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2019) co-located with the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019), 2019

Crowdsourcing Peer Review: As We May Do.

[BibT_eX]

[DOI]

Proceedings of the Digital Libraries: Supporting Open Science, 2019

Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models.

[BibT_eX]

[DOI]

Proceedings of the 10th Italian Information Retrieval Workshop, 2019

Towards Stochastic Simulations of Relevance Profiles.

[BibT_eX]

[DOI]

Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019

On Transforming Relevance Scales.

[BibT_eX]

[DOI]

Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019

2018

Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation.

[BibT_eX]

[DOI]

ACM J. Data Inf. Qual., 2018

Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments.

[BibT_eX]

[DOI]

ACM J. Data Inf. Qual., 2018

Effectiveness Evaluation with a Subset of Topics: A Practical Approach.

[BibT_eX]

[DOI]

Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

IRevalOO: An Object Oriented Framework for Retrieval Evaluation.

[BibT_eX]

[DOI]

Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

On Fine-Grained Relevance Scales.

[BibT_eX]

[DOI]

Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin.

[BibT_eX]

[DOI]

Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

Are we on the Right Track?: An Examination of Information Retrieval Methodologies.

[BibT_eX]

[DOI]

Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

A Formal Account of Effectiveness Evaluation and Ranking Fusion.

[BibT_eX]

[DOI]

Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval, 2018

How Many Truth Levels? Six? One Hundred? Even More? Validating Truthfulness of Statements via Crowdsourcing.

[BibT_eX]

[DOI]

Proceedings of the CIKM 2018 Workshops co-located with 27th ACM International Conference on Information and Knowledge Management (CIKM 2018), 2018

Multidimensional News Quality: A Comparison of Crowdsourcing and Nichesourcing.

[BibT_eX]

[DOI]

Davide Ceolin

Proceedings of the CIKM 2018 Workshops co-located with 27th ACM International Conference on Information and Knowledge Management (CIKM 2018), 2018

2017

Mobile Information Retrieval

[BibT_eX]

[DOI]

Springer Briefs in Computer Science, Springer, ISBN: 978-3-319-60776-4, 2017

On Crowdsourcing Relevance Magnitudes for Information Retrieval Evaluation.

[BibT_eX]

[DOI]

ACM Trans. Inf. Syst., 2017

Report on the SIGIR 2017 Workshop on Axiomatic Thinking for Information Retrieval and Related Tasks (ATIR).

[BibT_eX]

[DOI]

SIGIR Forum, 2017

Axiomatic Thinking for Information Retrieval: And Related Tasks.

[BibT_eX]

[DOI]

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

Economic Evaluation of Recommender Systems: A Proposal.

[BibT_eX]

[DOI]

Giuseppe Serra

Proceedings of the 8th Italian Information Retrieval Workshop, 2017

Considering Assessor Agreement in IR Evaluation.

[BibT_eX]

[DOI]

Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, 2017

Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing.

[BibT_eX]

[DOI]

Proceedings of the Fifth AAAI Conference on Human Computation and Crowdsourcing, 2017

Do Easy Topics Predict Effectiveness Better Than Difficult Topics?

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2017

Human-Based Query Difficulty Prediction.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2017

2016

Report on ECIR 2016: 38th European Conference on Information Retrieval.

[BibT_eX]

[DOI]

Giorgio Maria Di Nunzio

SIGIR Forum, 2016

Why do you Think this Query is Difficult?: A User Study on Human Query Prediction.

[BibT_eX]

[DOI]

Josiane Mothe

Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016

Improving the Efficiency of Retrieval Effectiveness Evaluation: Finding a Few Good Topics with Clustering?

[BibT_eX]

[DOI]

Proceedings of the 7th Italian Information Retrieval Workshop, 2016

Towards building a standard dataset for Arabic keyphrase extraction evaluation.

[BibT_eX]

[DOI]

Proceedings of the 2016 International Conference on Asian Language Processing, 2016

Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge.

[BibT_eX]

[DOI]

Proceedings of the Fourth AAAI Conference on Human Computation and Crowdsourcing, 2016

Exploiting News to Categorize Tweets: Quantifying the Impact of Different News Collections.

[BibT_eX]

[DOI]

Proceedings of the First International Workshop on Recent Trends in News Information Retrieval co-located with 38th European Conference on Information Retrieval (ECIR 2016), 2016

2015

Geographic dimensions of relevance.

[BibT_eX]

[DOI]

Stefano De Sabbata

Tumasch Reichenbacher

J. Documentation, 2015

Mobile crowdsourcing: four experiments on platforms and tasks.

[BibT_eX]

[DOI]

Distributed Parallel Databases, 2015

The Benefits of Magnitude Estimation Relevance Assessments for Information Retrieval Evaluation.

[BibT_eX]

[DOI]

Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

Finding Important Locations: A Feature-Based Approach.

[BibT_eX]

[DOI]

Proceedings of the 16th IEEE International Conference on Mobile Data Management, 2015

Content-Based Similarity of Twitter Users.

[BibT_eX]

[DOI]

Marco Pavan

Proceedings of the Advances in Information Retrieval, 2015

Judging Relevance Using Magnitude Estimation.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2015

Different Rankers on Different Subcollections.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2015

A Formal Approach to Effectiveness Metrics for Information Access: Retrieval, Filtering, and Clustering.

[BibT_eX]

[DOI]

Julio Gonzalo

Proceedings of the Advances in Information Retrieval, 2015

2014

Short text categorization exploiting contextual enrichment and external knowledge.

[BibT_eX]

[DOI]

Proceedings of the SoMeRA'14, 2014

TREC: topic engineering exercise.

[BibT_eX]

[DOI]

Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

A general account of effectiveness metrics for information tasks: retrieval, filtering, and clustering.

[BibT_eX]

[DOI]

Julio Gonzalo

Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

Magnitudes of Relevance: Relevance Judgements, Magnitude Estimation, and Crowdsourcing.

[BibT_eX]

[DOI]

Proceedings of the Sixth International Workshop on Evaluating Information Access, 2014

Preface.

[BibT_eX]

[DOI]

Ruihua Song

Proceedings of the Sixth International Workshop on Evaluating Information Access, 2014

The Axiometrics Project.

[BibT_eX]

[DOI]

Proceedings of the 5th Italian Information Retrieval Workshop, 2014

Size and Source Matter: Understanding Inconsistencies in Test Collection-Based Evaluation.

[BibT_eX]

[DOI]

Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, 2014

A context-aware retrieval system for mobile applications.

[BibT_eX]

[DOI]

Proceedings of the 4th Workshop on Context-Awareness in Retrieval and Recommendation, 2014

Axiometrics: Axioms of Information Retrieval Effectiveness Metrics.

[BibT_eX]

[DOI]

Proceedings of the Second Australasian Web Conference, 2014

Mining Movement Data to Extract Personal Points of Interest: A Feature Based Approach.

[BibT_eX]

[DOI]

Marco Pavan

Proceedings of the Information Filtering and Retrieval, 2014

2013

Axiometrics: An Axiomatic Approach to Information Retrieval Effectiveness Metrics.

[BibT_eX]

[DOI]

Luca Busin

Proceedings of the International Conference on the Theory of Information Retrieval, 2013

On Using Fewer Topics in Information Retrieval Evaluations.

[BibT_eX]

[DOI]

Andrea Berto

Stephen Robertson

Proceedings of the International Conference on the Theory of Information Retrieval, 2013

Crowdsourcing to Mobile Users: A Study of the Role of Platforms and Tasks.

[BibT_eX]

[DOI]

Proceedings of the First VLDB Workshop on Databases and Crowdsourcing, 2013

2012

Readersourcing - a manifesto.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2012

Using crowdsourcing for TREC relevance assessment.

[BibT_eX]

[DOI]

Omar Alonso

Inf. Process. Manag., 2012

Classical vs. Crowdsourcing Surveys for Eliciting Geographic Relevance Criteria.

[BibT_eX]

[DOI]

Stefano De Sabbata

Omar Alonso

Proceedings of the 3rd Italian Information Retrieval Workshop, 2012

Tag Clouds and Retrieved Results: The CloudCredo Mobile Clustering Engine and its Evaluation.

[BibT_eX]

[DOI]

Luca Sartori

Giacomo Strangolino

Proceedings of the 3rd Italian Information Retrieval Workshop, 2012

Sull'Uso di Meno Topics nelle Iniziative di Valutazione per l'Information Retrieval.

[BibT_eX]

[DOI]

Andrea Berto

Proceedings of the 3rd Italian Information Retrieval Workshop, 2012

2011

A social approach to context-aware retrieval.

[BibT_eX]

[DOI]

Luca Vassena

World Wide Web, 2011

IR Models Based on Network Science: A Research Agenda.

[BibT_eX]

[DOI]

Giulio Leso

Proceedings of the 2nd Italian Information Retrieval (IIR) Workshop, 2011

Teaching Web Information Retrieval to Computer Science Students: Concrete Approach and Its Analysis.

[BibT_eX]

[DOI]

Proceedings of the Teaching and Learning in Information Retrieval, 2011

2010

AI Techniques in a Context-Aware Ubiquitous Environment.

[BibT_eX]

[DOI]

Proceedings of the Pervasive Computing, 2010

The Context-Aware Browser.

[BibT_eX]

[DOI]

IEEE Intell. Syst., 2010

2009

A few good topics: Experiments in topic set reduction for retrieval evaluation.

[BibT_eX]

[DOI]

John Guiver

Stephen Robertson

ACM Trans. Inf. Syst., 2009

Mobile information retrieval with search results clustering: Prototypes and evaluations.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2009

QuWi: quality control in Wikipedia.

[BibT_eX]

[DOI]

Alberto Cusinato

Francesco Di Salvatore

Proceedings of the 3rd ACM Workshop on Information Credibility on the Web, 2009

Relevance criteria for e-commerce: a crowdsourcing-based experimental analysis.

[BibT_eX]

[DOI]

Omar Alonso

Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009

Evaluating Mobile Proactive Context-Aware Retrieval: An Incremental Benchmark.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval Theory, 2009

IR Evaluation without a Common Set of Topics.

[BibT_eX]

[DOI]

Matteo Cattelan

Proceedings of the Advances in Information Retrieval Theory, 2009

Context Aware Browser.

[BibT_eX]

[DOI]

Proceedings of the Interactive Information Retrieval, 01.03. - 06.03.2009, 2009

2008

m-Dvara 2.0: Mobile & Web 2.0 Services Integration for Cultural Heritage.

[BibT_eX]

[DOI]

Proceedings of the WWW 2008 Workshop on Social Web and Knowledge Management, 2008

Retrieval of context-aware applications on mobile devices: how to evaluate?

[BibT_eX]

[DOI]

Elena Nazzi

Luca Vassena

Proceedings of the 2nd International Conference on Information Interaction in Context, 2008

3-SHIRT: Three-Dimensional Shape Indexing and Retrieval Techniques.

[BibT_eX]

[DOI]

Umberto Castellani

Guido Maria Cortelazzo

Proceedings of the Eurographics Italian Chapter Conference 2008, Salerno, Italy, 2008, 2008

The Good, the Bad, the Difficult, and the Easy: Something Wrong with Information Retrieval Evaluation?.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval , 2008

AI on the Move: Exploiting AI Techniques for Context Inference on Mobile Devices.

[BibT_eX]

[DOI]

Proceedings of the ECAI 2008, 2008

Mobile Social Software for Cultural Heritage: A Reference Model.

[BibT_eX]

[DOI]

Proceedings of the BIS 2008 Workshops Proceedings: Social Aspects of the Web (SAW 2008), 2008

2007

Hits hits TREC: exploring IR evaluation results with network analysis.

[BibT_eX]

[DOI]

Stephen Robertson

Proceedings of the SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007

2006

Theme issue on interactive mobile information access.

[BibT_eX]

[DOI]

Pers. Ubiquitous Comput., 2006

MUIA 2006: third international workshop on mobile and ubiquitous information access.

[BibT_eX]

[DOI]

Matt Jones

Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services, 2006

Experiments on Average Distance Measure.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2006

A Classification of IR Effectiveness Metrics.

[BibT_eX]

[DOI]

Gianluca Demartini

Proceedings of the Advances in Information Retrieval, 2006

Mobile Clustering Engine.

[BibT_eX]

[DOI]

Proceedings of the Advances in Information Retrieval, 2006

2004

Measuring retrieval effectiveness: A new proposal and a first experimental validation.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2004

Evaluating ADM on a Four-Level Relevance Scale Document Set from NTCIR.

[BibT_eX]

[DOI]

Luca Di Gaspero

Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies Information Retrieval, 2004

Second International Workshop on Mobile and Ubiquitous Information Access.

[BibT_eX]

[DOI]

Matt Jones

Proceedings of the Mobile Human-Computer Interaction, 2004

2003

Quality control in scholarly publishing: A new proposal.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2003

The Concept of Relevance in Mobile and Ubiquitous Information Access.

[BibT_eX]

[DOI]

Proceedings of the Mobile and Ubiquitous Information Access, 2003

E-Mail on the Move: Categorization, Filtering, and Alerting on Mobile Devices with the ifMail Prototype.

[BibT_eX]

[DOI]

Proceedings of the Mobile and Ubiquitous Information Access, 2003

Advancing relevance research: Theory integration, methodological progress, and critical questions. Sponsored by SIG CRS, USE.

[BibT_eX]

[DOI]

Proceedings of the Humanizing Information Technology: From Ideas to Bits and Back, 2003

E-mail Categorization, Filtering, and Alerting on Mobile Devices: The ifMail Prototype and its Experimental Evaluation.

[BibT_eX]

[DOI]

Marco Cignini

Carlo Tasso

Proceedings of the AI*IA 2003: Advances in Artificial Intelligence, 2003

2002

Strategic help in user interfaces for information retrieval.

[BibT_eX]

[DOI]

J. Assoc. Inf. Sci. Technol., 2002

Ephemeral and Persistent Personalization in Adaptive Information Access to Scholarly Publications on the Web.

[BibT_eX]

[DOI]

Carlo Tasso

Proceedings of the Adaptive Hypermedia and Adaptive Web-Based Systems, 2002

2000

Effectiveness of keyword-based display and selection of retrieval results for interactive searches.

[BibT_eX]

[DOI]

Int. J. Digit. Libr., 2000

An Automatically Refereed Scholarly Electronic Journal: Formal Specifications.

[BibT_eX]

Paolo Zandegiacomo Rizio

Informatica (Slovenia), 2000

Towards a Theory of Epistemic Information.

[BibT_eX]

Proceedings of the Information Modelling and Knowledge Bases XII: Tenth European-Japanese Conference on Information Modelling and Knowledge Bases, 2000

1999

Measuring the Agreement Among Relevance Judges.

[BibT_eX]

[DOI]

Proceedings of Mira 99: Evaluating Interactive Information Retrieval, 1999

Negotiating a Multidimensional Framework for Relevance Space.

[BibT_eX]

[DOI]

Silvia Gabrielli