Building Rome from a Single Image
A redesigned object-centric generator partitions scenes into distance-adaptive chunks, captures 2D-3D correspondence, and trains on 4,000 outdoor scenes to outperform baselines in indoor and outdoor mesh generation.
Published Oct 6, 2026▲ 4 on Hugging FacearXiv ↗
Only vote on papers you've read. Sign in with GitHub to vote.
A distance-adaptive chunking and 4,000-scene synthetic dataset extends object priors to outdoor scenes with impressive geometric fidelity, yet critics question whether the chunking hides seams and if the synthetic gap truly serves real-world sparse-capture needs.
Abstract
Single-image scene generation aims to produce a complete 3D scene mesh from a single image, including surfaces the camera did not observe. While pretrained 3D object generators encode a strong shape prior, they are mainly designed for isolated objects in a fixed canonical volume and focus mostly on indoor scenes, since diverse 3D data for outdoor scenes are quite limited. In this work, we present a method that redesigns such an object-centric generator, e.g., Trellis 2, to work on both indoor and outdoor scenes while retaining its prior. We accomplish this by (a) partitioning the scene into adaptive chunks that scale relative to the distance to the camera; nearby chunks have a smaller size to keep the finer detail, while distant structures, e.g., buildings, are covered by large chunks; (b) making the generator capture explicit 2D-3D correspondence by lifting image features and making the model aware of the free space, observed surface, and unobserved region; (c) synthesizing around 4,000 outdoor scenes to broaden the training data, as existing scene datasets are largely indoor. Experiments on Tanks and Temples, ScanNet++, and in-the-wild images show that our method outperforms all baselines in geometric accuracy and perceptual quality across both indoor and outdoor scenes.