A Generic Hybrid Framework for 2D Visual Reconstruction
A hybrid framework pairs deep learning compatibility measures with a genetic algorithm to solve jigsaw puzzles, achieving state-of-the-art reconstruction of Portuguese tile panels and degraded puzzles.
Published Jan 31, 2025arXiv ↗
Only vote on papers you've read. Sign in to vote.
Abstract
This paper presents a versatile hybrid framework for addressing 2D real-world reconstruction tasks formulated as jigsaw puzzle problems (JPPs) with square, non-overlapping pieces. Our approach integrates a deep learning (DL)-based compatibility measure (CM) model that evaluates pairs of puzzle pieces holistically, rather than focusing solely on their adjacent edges as traditionally done. This DL-based CM is paired with an optimized genetic algorithm (GA)-based solver, which iteratively searches for a global optimal arrangement using the pairwise CM scores of the puzzle pieces. Extensive experimental results highlight the framework's adaptability and robustness across multiple real-world domains. Notably, our unique hybrid methodology achieves state-of-the-art (SOTA) results in reconstructing Portuguese tile panels and large degraded puzzles with eroded boundaries.