Hey guys,
this year at Siggraph some really cool technology has been introduced. There already are some implementations for Blender and Unreal, so it would be cool to have in V-Ray as well.
You can think of this as photogrammetry on steroids.
Yeah I’ve seen some amazing videos about it recently and I really wish there is something like that in Max.
I’ve seen some blender users render different cameras to cover a full scene then take that to a tool that can convert t to 3D Gaussian Splatting thing .
the splatting preview kinda reminded me of the light cache/irradiance map when viewed inside the Irradiance map viewer so that might help maybe?
other use case was taking clips from movies to convert them to a 3D Gaussian Splatting scenes then put that into unreal to re-render it from different view and add 3d elements to it ,
https://www.youtube.com/watch?v=8CdL…ecisionsStudio ( Sorry for the over-reacting and cringe jokes in advanced )
and here is a tool that can do that online in addition to few interactive examples to see how cool such tech can be ( especially with capturing reflection and transparency)
https://poly.cam/gaussian-splatting
Yeah, I closely followed PolyCam. Somehow their results look worse than what is possible with the viewer from GitHub.
Creating scenes with 3D Gaussian Splatting and then placing objects in them (well, cars in our case), would be very handy.
Yes, I was just actually thinking about this the other day… we did some experiments with NeRFs but that didn’t work out too well, hopefully Gaussian splats will work better. My own results from converting videos to Gaussian splats have been quite disappointing but maybe the renderer can provide better input 3D data.
Best regards,
Vlado
Hey Vlado,
great to hear!
The researchers uploaded scene files along with the input data, the results are very promising. I have various sets of images intended for photogrammetry sessions, those should work well with 3D Gaussian Splatting, too. Hope I can find some spare time to test this.
There are hundreds of videos already on Youtube. The first one is amazing, the scene is actually reconstructed in the reflection of the pond, too.
Very very cool, thanks for that!
One question regarding the car: The reflections in the car paint is based on the G-Splat volumes or did you use an HDRI or roughly blocked-out geometry for that?
Thanks, and your plugin sounds interesting!
Concerning GSplat quality: that’s a rather broad topic and probably a bit off topic for this messaging board.
I’ve sent you a PM.
Hey Asen, this sounds great!
Can you please elaborate on the reflections/refractions? Do you mean the Gaussian Splatting scene will be reflected/refracted in the objects we render with V-Ray? If so, can the GS also cast GI?
Hi!
Yes, exactly! The GS will be something like pre-baked environment which can be seen in camera or through reflections and refractions from the scene objects. We plan to publish the plugin here for testing. At the moment, we haven’t considered GI, but we will pay attention to the relevant use cases and the feedback from you!
Best,
Asen
That’s fantastic, thank you so much!
Hey Asen,
first of all thanks for looking into GS for Vray - I can’t wait to test this! Even without support for reflections or refractions!
Will this work in Maya and/or Houdini?
Could this be brought to USD land as well?
Cheers
Oli
Some more inspiration:
This is useful for combining 3D with Gaussian Splatting techniques
Exciting! Looking forward to more.
Great news!
Out of curiosity: The reflections in the teapot are created by the Gaussian Splats?
Yes, the reflections come from the Gaussian splats.
Best regards,
Vlado
Great, thanks for the confirmation!
Here is another video that I rendered recently, showing some more raytaced effects for GS like motion blur, reflections, refractions and interactions with matte/shadow surfaces.
Best regards,
Vlado
That is really really cool!