SIGIR 2024Information retrieval TH Köln - University of Applied Technische Hochschule Mittelhess U Duisburg-Essen U Stavanger U Wolverhampton Bauhaus-Universität Weimar

Report on the 1st Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024

Sim4IA 2024 workshop report highlights user simulation's growing importance, online-offline evaluation bridging, and shared task organization challenges.

Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji, Gareth J. F. Jones, Jüri Keller, Jiqun Liu, Martin Mladenov, Gabriella Pasi, Johanne R. Trippas, Xi Wang, Saber Zerhoudi, ChengXiang Zhai

Published Dec 1, 20247 citationsPaper ↗

64%

OverallWorth a look

OverallWorth a lookVote to see the score

Readers

–

Only vote on papers you've read. Sign in to vote.

AI panel2/20reviewers recommend it

lenient 1/5

medium 0/10

strict 1/5

AI panel?Vote to see what the 20 AI reviewers said

Abstract

This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talks, and two breakout sessions. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access. We report on how we organized the workshop, provide a brief overview of what happened at the workshop, and summarize the main topics and findings of the workshop and future work. Date : 18 July 2024. Website : https://sim4ia.org/sigir2024.