Paul Thomas

Orcid: 0000-0003-2425-3136

Affiliations:
  • Microsoft, Australia
  • CSIRO, Canberra, Australia (former)


According to our database1, Paul Thomas authored at least 92 papers between 2005 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Report on the 8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024) at CHIIR 2024.
SIGIR Forum, June, 2024

SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval.
CoRR, 2024

Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024.
CoRR, 2024

LLM4Eval: Large Language Model for Evaluation in IR.
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024

Large Language Models can Accurately Predict Searcher Preferences.
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024

What Matters in a Measure? A Perspective from Large-Scale Search Evaluation.
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024

LLMJudge: LLMs for Relevance Judgments.
Proceedings of The First Workshop on Large Language Models for Evaluation in Information Retrieval (LLM4Eval 2024) co-located with 10th International Conference on Online Publishing (SIGIR 2024), 2024

Enhancing Human Annotation: Leveraging Large Language Models and Efficient Batch Processing.
Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval, 2024

2023
Can Generative LLMs Create Query Variants for Test Collections? An Exploratory Study.
Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023

Taking Search to Task.
Proceedings of the 2023 Conference on Human Information Interaction and Retrieval, 2023

2022
A Flexible Framework for Offline Effectiveness Metrics.
Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

Search Interfaces for Biomedical Searching: How do Gaze, User Perception, Search Behaviour and Search Performance Relate?
Proceedings of the CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14, 2022

Third Workshop on Building towards Information Interaction and Retrieval Resources Re-use (BIIRRR 2022).
Proceedings of the CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14, 2022

The Crowd is Made of People: Observations from Large-Scale Crowd Labelling.
Proceedings of the CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14, 2022

2021
Theories of Conversation for Conversational IR.
ACM Trans. Inf. Syst., 2021

Report on the future conversations workshop at CHIIR 2021.
SIGIR Forum, 2021

Report on the 1st simulation for information retrieval workshop (Sim4IR 2021) at SIGIR 2021.
SIGIR Forum, 2021

Do Affective Cues Validate Behavioural Metrics for Search?
Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

Sim4IR: The SIGIR 2021 Workshop on Simulation for Information Retrieval Evaluation.
Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

Analysing Mixed Initiatives and Search Strategies during Conversational Search.
Proceedings of the CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1, 2021

User Models, Metrics and Measures of Search: A Tutorial on the C/W/L Evaluation Framework.
Proceedings of the CHIIR '21: ACM SIGIR Conference on Human Information Interaction and Retrieval, 2021

2020
Simulating Information Retrieval Test Collections
Synthesis Lectures on Information Concepts, Retrieval, and Services, Morgan & Claypool Publishers, ISBN: 978-3-031-02323-1, 2020

Investigating Searchers' Mental Models to Inform Search Explanations.
ACM Trans. Inf. Syst., 2020

Towards a model for spoken conversational search.
Inf. Process. Manag., 2020

Expressions of Style in Information Seeking Conversation with an Agent.
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Third International Workshop on Conversational Approaches to Information Retrieval (CAIR'20): Full-day Workshop at CHIIR 2020.
Proceedings of the CHIIR '20: Conference on Human Information Interaction and Retrieval, 2020

Data-Driven Evaluation Metrics for Heterogeneous Search Engine Result Pages.
Proceedings of the CHIIR '20: Conference on Human Information Interaction and Retrieval, 2020

2019
The Emotion Profile of Web Search.
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

cwl_eval: An Evaluation Tool for Information Retrieval.
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

Building Economic Models and Measures of Search.
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019

Data Sets for Spoken Conversational Search.
Proceedings of the CHIIR 2019 Workshop on Barriers to Interactive IR Resources Re-use co-located with the ACM SIGIR Conference on Human Information Interaction and Retrieval, 2019

2018
Measuring the Utility of Search Engine Result Pages: An Information Foraging Based Measure.
Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

Style and Alignment in Information-Seeking Conversation.
Proceedings of the 2018 Conference on Human Information Interaction and Retrieval, 2018

Better Effectiveness Metrics for SERPs, Cards, and Rankings.
Proceedings of the 23rd Australasian Document Computing Symposium, 2018

2017
Incorporating User Expectations and Behavior into the Measurement of Search Effectiveness.
ACM Trans. Inf. Syst., 2017

Retrieval Consistency in the Presence of Query Variations.
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

Multimodal analysis of vocal collaborative search: a public corpus and results.
Proceedings of the 19th ACM International Conference on Multimodal Interaction, 2017

What Snippet Size is Needed in Mobile Web Search?
Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, 2017

Tasks, Queries, and Rankers in Pre-Retrieval Performance Prediction.
Proceedings of the 22nd Australasian Document Computing Symposium, 2017

2016
Understanding eye movements on mobile devices for better presentation of search results.
J. Assoc. Inf. Sci. Technol., 2016

UQV100: A Test Collection with Query Variability.
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016

Pagination versus Scrolling in Mobile Web Search.
Proceedings of the 25th ACM International Conference on Information and Knowledge Management, 2016

Measuring Engagement with Online Forms.
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, 2016

System And User Centered Evaluation Approaches in Interactive Information Retrieval (SAUCE 2016).
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, 2016

2015
Eye-tracking analysis of user behavior and performance in web search on large and small screens.
J. Assoc. Inf. Sci. Technol., 2015

Features of Disagreement Between Retrieval Effectiveness Measures.
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

User Variability and IR System Evaluation.
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

Pooled Evaluation Over Query Variations: Users are as Diverse as Systems.
Proceedings of the 24th ACM International Conference on Information and Knowledge Management, 2015

Towards Nuanced System Evaluation Based on Implicit User Expectations.
Proceedings of the Information Retrieval Technology, 2015

Text segmentation and Chinese site search.
Proceedings of the 20th Australasian Document Computing Symposium, 2015

Towards Searching Amongst Tables.
Proceedings of the 20th Australasian Document Computing Symposium, 2015

INST: An Adaptive Metric for Information Retrieval Evaluation.
Proceedings of the 20th Australasian Document Computing Symposium, 2015

2014
Using Interaction Data to Explain Difficulty Navigating Online.
ACM Trans. Web, 2014

Overview of the TREC 2014 Contextual Suggestion Track.
Proceedings of The Twenty-Third Text REtrieval Conference, 2014

Compositional data analysis (CoDA) approaches to distance in information retrieval.
Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

Modeling decision points in user search behavior.
Proceedings of the Fifth Information Interaction in Context Symposium, 2014

Assessing the Cognitive Complexity of Information Needs.
Proceedings of the 2014 Australasian Document Computing Symposium, 2014

2013
Overview of the TREC 2013 Contextual Suggestion Track.
Proceedings of The Twenty-Second Text REtrieval Conference, 2013

Evaluating Contextual Suggestion.
Proceedings of the 5th International Workshop on Evaluating Information Access, 2013

Fading Away: Dilution and User Behaviour.
Proceedings of the 3rd European Workshop on Human-Computer Interaction and Information Retrieval, 2013

Filtering and Ranking for Social Media Monitoring.
Proceedings of the CORIA 2013 - Conférence en Recherche d'Infomations et Applications, 2013

Users versus models: what observation tells us about effectiveness metrics.
Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, 2013

What Users Do: The Eyes Have It.
Proceedings of the Information Retrieval Technology, 2013

Choices in batch information retrieval evaluation.
Proceedings of the Australasian Document Computing Symposium, 2013

Merging algorithms for enterprise search.
Proceedings of the Australasian Document Computing Symposium, 2013

2012
To what problem is distributed information retrieval the solution?
J. Assoc. Inf. Sci. Technol., 2012

Unifying Local and Global Agreement and Disagreement Classification in Online Debates.
Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis, 2012

Finding, Weighting and Describing Venues: CSIRO at the 2012 TREC Contextual Suggestion Track.
Proceedings of The Twenty-First Text REtrieval Conference, 2012

Overview of the TREC 2012 Contextual Suggestion Track.
Proceedings of The Twenty-First Text REtrieval Conference, 2012

Differences in Language and Style Between Two Social Media Communities.
Proceedings of the Sixth International Conference on Weblogs and Social Media, 2012

Do Users Benefit from Controlled Vocabularies in Search Interfaces?
Proceedings of the 2nd European Workshop on Human-Computer Interaction and Information Retrieval, 2012

Explaining difficulty navigating a website using page view data.
Proceedings of the Seventeenth Australasian Document Computing Symposium, 2012

Models and metrics: IR evaluation as a user process.
Proceedings of the Seventeenth Australasian Document Computing Symposium, 2012

Comparing scanning behaviour in web search on small and large screens.
Proceedings of the Seventeenth Australasian Document Computing Symposium, 2012

2011
What deliberately degrading search quality tells us about discount functions.
Proceedings of the Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2011

Relative effect of spam and irrelevant documents on user interaction with search engines.
Proceedings of the 20th ACM Conference on Information and Knowledge Management, 2011

2010
Focused and aggregated search: a perspective from natural language generation.
Inf. Retr., 2010

Evaluating interfaces for government metasearch.
Proceedings of the Information Interaction in Context Symposium, 2010

Evaluating Server Selection for Federated Search.
Proceedings of the Advances in Information Retrieval, 2010

2009
Server selection methods in personal metasearch: a comparative empirical study.
Inf. Retr., 2009

Overview of the TREC 2009 Entity Track.
Proceedings of The Eighteenth Text REtrieval Conference, 2009

SUSHI: scoring scaled samples for server selection.
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009

Effective query expansion for federated search.
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009

2008
Overview of the TREC 2008 Enterprise Track.
Proceedings of The Seventeenth Text REtrieval Conference, 2008

Generalising multiple capture-recapture to non-uniform sample sizes.
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008

Relevance assessment: are judges exchangeable and does it matter.
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008

Experiences evaluating personal metasearch.
Proceedings of the 2nd International Conference on Information Interaction in Context, 2008

2007
Estimating the value of automatic disambiguation.
Proceedings of the SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007

Evaluating sampling methods for uncooperative collections.
Proceedings of the SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007

2006
Evaluation by comparing result sets in context.
Proceedings of the 2006 ACM CIKM International Conference on Information and Knowledge Management, 2006

2005
TREC 14 Enterprise Track at CSIRO and ANU.
Proceedings of the Fourteenth Text REtrieval Conference, 2005

Server selection methods in hybrid portal search.
Proceedings of the SIGIR 2005: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2005


  Loading...