89%Must read
?Must readVote to see the score
Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
Medmarks introduces 30 open-source medical benchmarks evaluating 61 LLMs, finding frontier reasoning models lead, proprietary models are more token-efficient, medical fine-tuning helps, and smaller models show answer-order bias.
Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 2 on Hugging Face
– ReadersNo votes yet
16/20 AI panelreviewers recommend it
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
AI panel: 16 of 20 reviewers recommend it
lenient 5/5
medium 8/10
strict 3/5