Unity Add-on
Installation and Use
About
With this package, users can:
Enter text prompts to generate 3D Gaussian Splats assets
Display 3D Gaussian Splats assets inside Unity
Perform basic transformations on 3D Gaussian Splats
Installation
Software requirements
Unity 2022.3+
Instructions
1. Click "Add to My Assets"
2. Download the Package
In Unity, create a new 3D project or open an existing one
Go to My Assets
Select 404—GEN from the list
Click "Download"
3. Import the Package
After the package has been downloaded, click "Import"
When the import window appears, keep all files selected and click "Import"
4. Edit Project Settings
Make sure that the correct rendering backend is selected
D3D12 on Windows
Metal on Mac
Vulkan on Linux
Scroll down and check the Allow 'unsafe' Code box
Universal Rendering Pipeline (URP)
As rendering Gaussian Splats differs from rendering 3D models represented with meshes and textures, a Renderer Feature must be added to the URP Renderer Asset for each of the three default quality levels, Balanced, HighFidelity, and Performant.
Unity 6 requires enabling Compatibility Mode (Render Graph Disabled) to use the custom Renderer Feature included in this package. This setting is in Project Settings > Graphics > Pipeline Specific Settings > URP > Render Graph
From the Project folder, go to Assets > Settings
Select the asset labeled
URP-Balanced-Rendereror in Unity 6,PC_Renderer (Universal Renderer Data)
In the Inspector, under Renderer Features, click Add Renderer Feature
Select Gaussian Splat URP Feature
Repeat this process for the High Fidelity and Performant Renderer assets.
High Definition Render Pipeline (HDRP)
With HDRP, a Custom Pass Volume can be injected into the render loop, either globally or within a certain area.
Go to Game Object -> Create Empty to add a new Game Object to the scene and name it
GaussianSplatEffectIn the Inspector, use the Add Component button to add a Custom Pass Volume
Set the Mode to Global unless you only intend to use Gaussian Splats in a specific area, defined by colliders.
Set the Injection Point to either Before Transparent or After Post Process (recommended).
Under Custom Passes click the + button and select Gaussian Splat HDRP Pass.
Usage
Generating
Go to Window > 404-GEN 3D Generator to open the generation window
Type your prompt and click Generate. Each generation should take approximately one minute.
Results are generated on a decentralized AI network utilizing a variety of 3D generative AI models. Sometimes, a result does not meet our minimum quality threshold, in which case the prompt will display a failed status. You can try the same prompt again, or slightly re-word it.
Prompts
For help structuring prompts, visit the Prompts section of this guide:
PromptsTransformations
In addition to the Position, Rotation, and Scale values in the Inspector, there are two easily adjustable values.
Splat Scale: Controls the size of the points, represented by ellipsoids, in the Gaussian Splat
Opacity Scale: Points within Gaussian Splats have varying degrees of opacity. This increases or decreases the opacity of all points.
Cutouts
The cutouts feature can be used to hide a selection of points within the Gaussian Splat, defined by either a box or ellipsoid.
Create a cutout for a selected Gaussian Splat by clicking Add Cutout under the Cutouts heading of the Inspector.
Select a shape and move/scale/rotate as needed.
By default, only the points inside the cutout will be rendered. Select invert to render the points outside the cutout.
Mesh Collider
The Add Mesh Collider button in the Inspector will add a convex hull mesh collider. This collider applies to the original Gaussian Splat and does not apply cutouts.
Gaussian Splats
To learn more about 3DGS (3D Gaussian Splatting), visit the Gaussian Splatting section of this guide:
3D Gaussian Splatting (3DGS)Last updated
