Vlad Erium ๐ฏ๐ต (@ssh4net)
2025-02-14 | โค๏ธ 17 | ๐ 1
Self-Calibrating Gaussian Splatting for Large Field of View Reconstruction Youming Deng, Wenqi Xian, Guandao Yang, Leonidas Guibas, Gordon Wetzstein, Steve Marschner, Paul Debevec
Project: https://denghilbert.github.io/self-cali/ Code: https://github.com/denghilbert/Self-Cali-GS Paper: https://arxiv.org/abs/2502.09563
Abstract: In this paper, we present a self-calibrating framework that jointly optimizes camera parameters, lens distortion and 3D Gaussian representations, enabling accurate and efficient scene reconstruction. In particular, our technique enables high-quality scene reconstruction from Large field-of-view (FOV) imagery taken with wide-angle lenses, allowing the scene to be modeled from a smaller number of images. Our approach introduces a novel method for modeling complex lens distortions using a hybrid network that combines invertible residual networks with explicit grids. This design effectively regularizes the optimization process, achieving greater accuracy than conventional camera models. Additionally, we propose a cubemap-based resampling strategy to support large FOV images without sacrificing resolution or introducing distortion artifacts. Our method is compatible with the fast rasterization of Gaussian Splatting, adaptable to a wide variety of camera lens distortion, and demonstrates state-of-the-art performance on both synthetic and real-world datasets.
๐ ์๋ณธ ๋งํฌ
- https://denghilbert.github.io/self-cali/
- https://github.com/denghilbert/Self-Cali-GS
- https://arxiv.org/abs/2502.09563
๋ฏธ๋์ด
๐ Related
Auto-generated - needs manual review
Tags
domain-vision-3d domain-rendering domain-dev-tools domain-visionos