Good Papers
SIGIR 2024Information retrievalTH Köln - University of Applied Technische Hochschule MittelhessU Duisburg-EssenU Stavanger

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024

This report summarizes the Sim4IA 2024 workshop on user simulations for information access, emphasizing bridging online and offline evaluation and shared task organization challenges.

Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji, Gareth J. F. Jones, Jüri Keller, Jiqun Liu, Martin Mladenov, Gabriella Pasi, Johanne R. Trippas, Wang, Xi, Saber Zerhoudi, ChengXiang Zhai

Published Sep 26, 20241 citationarXiv ↗

64%
OverallWorth a look
?
OverallWorth a lookVote to see the score
Readers
–

Only vote on papers you've read. Sign in to vote.

AI panel2/20reviewers recommend it
lenient 1/5
medium 0/10
strict 1/5
AI panel?Vote to see what the 20 AI reviewers said

Abstract

This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talks, and two breakout sessions. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access. We report on how we organized the workshop, provide a brief overview of what happened at the workshop, and summarize the main topics and findings of the workshop and future work.