loader image

PROJECT

The power of 3D Gaussian Splatting

Get in Touch

As the landscape of immersive media is evolving at rapid pace, Boost remains at the forefront, continually exploring innovative techniques. With 3D Gaussian Splatting emerging as a game-changing innovation, the potential for transformative applications is immense.

Introducing Gaussian Splatting

Gaussian splatting is in its core a rasterization technique for 3D reconstruction and rendering. Think of Gaussian splatting as painting with dots in the digital world. Imagine you have a bunch of points representing objects or data (which we refer to as a “point cloud”).  Instead of drawing lines or shapes, you spread each point like a drop of paint, forming ‘splats’ that softly blend together.  Each splat is like a gentle dot that possesses individual colours and can be transparent. This creates smooth, continuous surfaces, making your digital world look more realistic and detailed.

Below, a individually rasterized gaussian with a border drawn for clarity.

Multiple gaussians when blended together.

How it works

1. Collect data

First, we gather as much data as possible from the subject. This means that all you need is a video or a set of photos from various angles. After importing this data into a system like COLMAP, we obtain the following result. 

2. Structure from Motion

The second step involves estimating a point cloud from a collection of images. This method obtains a 3D point cloud from a series of 2D images, this can also be done with COLMAP.

3. Convert to Gaussians


Now each data point is transformed into a Gaussian function, resembling a bell curve. This conversion allows for the creation of smooth surfaces by blending neighboring points together, resulting in a more visually appealing representation of the data.

4. Fully Rasterized

The Gaussian functions generated in the previous steps are now rasterized onto the screen. This involves rendering each Gaussian function as a pixel or group of pixels, creating a complete image of the smoothed surface. The result is a fully rendered representation of the data, ready for display or further analysis.

Unleashing potential

What’s al the fuss on Gaussian Splatting? Firstly you get high-quality scenes in real-time. But besides that it unlocks many other doors in different fields:

 

  • Graphic Design: It can facilitate the creation for more realistic 3D models and animations, enhancing the quality and speed of the design process
  • AR/VR: As we increasingly evolving in an augmented world, Gaussian Splatting can be a valuable tool for creating hyper-realistic VR backgrounds, elevating immersion levels within virtual environments.
  • Real Estate: The technique has the potential to transform the way properties are presented and explored from a distance. It can facilitate virtual tours in a more accessible way
  • E-Commerce: It has the potential to revolutionize online shopping by offering high-quality, real-time 3D rendering of products, resulting in more interactive and immersive shopping experiences.