3D-Gaussian-Splatting-based Immersive Street View Map

指导老师:Peisen Huang创建者:季诺澄

Team22  基于3D高斯泼溅的沉浸式街景地图

3D-Gaussian-Splatting-basedImmersive Street View Map

赞助方: 密西根学院

组员: 季诺澄,俞文博,崔学浩,张淏,何瑞颖

指导老师: 黄佩森,庄瀚洋

 

项目介绍:

2023年,国务院发布《数字中国建设整体布局规划》,强调要完善三维立体“一张图”和基础地理信息平台,构建以数字孪生为核心的信息化体系。如何重建好一张高质量的三维街景地图是重中之重,可以广泛应用于出行导航、广告文旅、虚拟现实等领域。同年,3D高斯泼溅(3DGS)技术诞生,可以大幅提升三维重建的质量和沉浸感。将3DGS技术应用于三维街景地图,具有广阔的发展前景。

然而,3DGS技术需要大量的算力资源,而当下地图的主要用户是移动端用户,算力不足以支持3DGS的落地。如何优化3DGS技术使之适配低算力的移动端是一大难题。因此,本项目旨在开发一个基于3DGS的移动端沉浸式街景地图应用程序,优化3DGS在移动端的渲染方法,取得较好的性能和可操作性。

 

In 2023, the State Council issued the Overall LayoutPlan for the Construction of Digital China, emphasizing the need toimprove the three-dimensional one map and basic geographicinformation platform, and build an information system with digital twins as thecore. How to reconstruct a high-quality 3D street view map is of utmostimportance, and can be widely applied in fields such as navigation, advertising,tourism, virtual reality, etc. In the same year, 3D Gaussian Splatting (3DGS)technology was born, which can significantly improve the quality and immersionof 3D reconstruction. The application of 3DGS technology to 3D street view mapshas broad development prospects.

However, 3DGS technology requires a large amount of computingpower resources, and currently the main users of maps are mobile users, withinsufficient computing power to support the implementation of 3DGS. How tooptimize 3DGS technology to adapt to low computing power mobile devices is amajor challenge. Therefore, this project aims to develop a mobile immersivestreet view map application based on 3DGS, optimize the rendering method of3DGS on mobile devices, and achieve good performance and operability.