71%Highly rated
?Highly ratedVote to see the score
Towards Understanding Self-Pretraining for Sequence Classification
Self-pretraining improves sequence classification by learning proximity-biased attention patterns that supervised training misses from random initialization.
Paris Poster Session 5, Fri, Dec 11, 11:30 AM–1:30 PM, Paris Poster Hall · Published 2026
– ReadersNo votes yet
7/20 AI panelreviewers recommend it
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
AI panel: 7 of 20 reviewers recommend it
lenient 3/5
medium 3/10
strict 1/5