MrNeRF (@janusch_patas)
2024-09-24 | โค๏ธ 146 | ๐ 28
SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality
Contributions: โข We propose an efficient and novel visual localization approach based on 3D Gaussian primitives that achieves accurate localization performance and high-quality, fast rendering with fewer parameters.
โข We introduce an unbiased 3D descriptor learning strategy for precise 2D keypoints and 3D Gaussian primitives matching, using a scene-specific 3D feature decoder to regress the feature volume from multi-view feature maps.
โข We develop an effective salient 3D landmark selection algorithm to reduce the number of primitives used for localization. Additionally, to mitigate the Gaussian primitive center shift induced by photometric rendering loss, we apply regularization on the location and scale of key Gaussian primitives.
โข We conduct extensive experiments to demonstrate the state-of-the-art and comparable performance of visual localization and high-quality novel view rendering.
๋ฏธ๋์ด
