← Back to Articles
⚠️
IEEE Published Article
This article is published by IEEE and the copyright belongs to IEEE. Please click here to access the full text.

2D-Guided 3D Gaussian Segmentation

View PDF

Abstract

Recently, 3D Gaussian, as an explicit 3D representation paradigm, has demonstrated strong competitiveness over NeRF (neural radiance fields) in terms of expressing complex scenes and training duration. These advantages signal a wide range of applications for 3D Gaussians in 3D understanding and editing. Meanwhile, the segmentation of 3D Gaussians is still in its infancy. The existing segmentation methods are not only cumbersome but also incapable of segmenting multiple objects simultaneously in a short amount of time. In response, this paper introduces a 3D Gaussian segmentation method implemented with 2D segmentation as supervision. This approach uses input 2D segmentation maps to guide the learning of the added 3D Gaussian semantic information, while nearest neighbor clustering and statistical filtering refine the segmentation results. Experiments show that our concise method can achieve comparable performances on mIOU and mAcc for multi-object segmentation as previous single-object segmentation methods.

Keywords

3D Gaussian 3D semantic Segmentation

Authors

K. Lan
University of Science and Technology of China
H. Li
University of Science and Technology of China
H. Shi
University of Science and Technology of China
W. Wu
University of Science and Technology of China
L. Wang
AI Thrust, HKUST(GZ)
Y. Liao
University of Science and Technology of China

Publication Details

Type
proceedings
Publisher
IEEE
Volume
Issue
ISSN
Citations
2
Views
0