Good Papers
LLM pretraining & scaling lawsAllen Institute for Artificial ICarnegie MellonU WashingtonStanfordUniversité de MontréalPrinceton

Olmo 3

Team OLMo, :, Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, Graham, David, David Heineman, Dirk Groeneveld, Faeze Brahman, Finbarr Timbers, Hamish Ivison, Jacob Morrison, Jake Poznanski, Kyle Lo, Luca Soldaini, Matt Jordan, Mayee F. Chen, Michael Noukhovitch, Nathan Lambert, Walsh, Pete, Pradeep Dasigi, Robert Berry, Saumya Malik, Saurabh Anil Shah, Scott Geng, Shane Arora, Shashank Rai Gupta, Anderson, Taira, Xiao, Teng, Murray, Tyler, Tyler Romero, Victoria Graf, Akari Asai, Akshita Bhagia, Alexander Wettig, Alisa Liu, Aman Rangapur, Chloe Anastasiades, Huang, Costa, Dustin Schwenk

Published Dec 15, 20255 citations▲ 38 on Hugging FaceCode ★ 1,720arXiv ↗

66%
OverallHighly rated
?
OverallHighly ratedVote to see the score
Readers
–

Only vote on papers you've read. Sign in to vote.

AI panel4/20reviewers recommend it
lenient 3/5
medium 1/10
strict 0/5
AI panel?Vote to see what the 20 AI reviewers said

Abstract

We introduce Olmo 3, a family of state-of-the-art, fully-open language models at the 7B and 32B parameter scales. Olmo 3 model construction targets long-context reasoning, function calling, coding, instruction following, general chat, and knowledge recall. This release includes the entire model flow, i.e., the full lifecycle of the family of models, including every stage, checkpoint, data point, and dependency used to build it. Our flagship model, Olmo 3 Think 32B, is the strongest fully-open thinking model released to-date.