home.social

#gaussian-splat — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #gaussian-splat, aggregated by home.social.

fetched live
  1. 🖼️🎮 Ah yes, the groundbreaking #innovation of "Gaussian Splat" gaming—because who doesn't want to spend their weekend turning an abstract math concept into a playable disappointment? #PlayCanvas flaunts splats like they're the new sliced bread, but we all know it's just an over-hyped Excel spreadsheet with graphics. 🥴🔢
    blog.playcanvas.com/turning-a- #GaussianSplat #Gaming #GamingDisappointment #AbstractMath #OverhypedTech #HackerNews #ngated

  2. Yoooo Gaussian Splats are fun!
    Created my first one yesterday and edited out some of the worst parts, now it looks like this!
    Kinda like a dream, I luv it!

    #gaussiansplat #splat #photography #art #experimenting #experiment

  3. Really cool tech - Gausian splatted character animations - feels like a 90's "multi-media" aesthetics - gaussian-vrm.github.io

    #gaussiansplat #graphics

  4. Something a bit different - using 3D Gaussian Splats for creating art.

    This started out as a Pictish standing stone up around Loch Kinord, Aberdeenshire. I took a video walking around it. Made a Gaussian Splat at some length. Found an interesting view where the splat artefacts look like a view through the surrounding tree foliage. Finished the tone processing in Luminar Neo.

    #art #photography #scotland #3d #gaussiansplat #aberdeenshire #standingstone #lochkinord

  5. Learn What a Gaussian Splat Is, Then Make One - Gaussian Splats is a term you have likely come across, probably in relation to 3D ... - hackaday.com/2025/10/31/learn- #machinelearning #photogrammetry #gaussiansplat #how-to #3d #vr

  6. 🤡 Behold the mighty *Gaussian Splat*, aka glorified blurry blobs 🏆! Witness the epic saga of Dany Bittel's blurry bug obsession, where macro photography's shallow focus valiantly defends against clarity. A true triumph of complexity over common sense 🎉.
    danybittel.ch/macro.html #GaussianSplat #BlurryBlobs #MacroPhotography #ComplexityOverCommonSense #DanyBittel #HackerNews #ngated

  7. Move over, Lithopane: 3D Printed 3D Photos with Gaussian Splats - If you had asked us yesterday “How do you 3D Print a Photo”, we would have said “w... - hackaday.com/2025/05/10/move-o #3dprinterhacks #gaussiansplat #dlpprinter #3dprint #resin

  8. With the ongoing improvement in AI and machine learning models, as well as adaptive, programmable workflows in environments like Python/Jupyter, ComfyUI, Blender and Unreal Engine, it is a productive time to look at new approaches in heritage visualisation and digital conservation.

    Main Entrance, Photogrammetric Model (2024). Image Source courtesy Dave Killick 2021-22.

    Over the last 20+ years I have accumulated an extensive database of images of the Cape Denison heritage site, including extensive external and internal imagery of Mawson’s Huts.

    This database includes not only my own photographic, video and audio documentation, but also the work of many other expeditioners to the site, courtesy of the first-rate people of the Mawson’s Huts Foundation, Australian Antarctic Division and IPEV. I am especially grateful to Rob Easther, who facilitated my two trips to the site, and also enabled me to work with members of other teams to generate structured image sets suitable for photogrammetry. Rob was a wonderful man who I admired greatly and counted as a friend – sadly he passed away in February 2024. Deservingly, he actually has an island in Antarctica (humorously) named after him – Easther Island. I also want to acknowledge Bruce Hull (formerly of the AAD) for employing me to document the site in 2006/7 and providing access to many documentary materials. This led to my first work for fulldome: ‘Frozen in Time’ (2008).

    https://vimeo.com/1618365

    As a consequence of these opportunities and connections, I have a database containing imagery from about 2002 to 2021. These are largely unordered collections – though with enough coverage to enable the assembly of multi-year sets that can be used for partial 3D reconstruction. Photogrammetry typically doesn’t work well with non-contiguous data (both spatial and temporal), but with masking it is possible to work around many registration issues. It’s a bit of a kludge, but seems to be working. The creation of masks is typically very labour-intensive, but fortunately I am now able to semi-automate the processing of thousands of files using AI text-vision models like SAM/SAM2 and Florence-2. Semantic segmentation and masking can also be semi-automated using locally installed private LLM systems like Ollama/llama3.2. ‘Semi-automated’ means ‘fragile’ – still requiring the human-in-the-loop. Combining these with other opensource processors like COLMAP, SuperSplat, NerfStudio, one can imagine a future ‘agentive’ workflow for dealing with large unordered image collections – similar to the approach griptape.ai is developing, but without the reliance upon external paid APIs. Interesting times indeed!

    Over time, I’ll post a few works-in-progress here, including photogrammetric and gaussian splat reconstructions, which will ultimately lead to a full 3D reconstruction in Unreal Engine. It’s been a long time coming, but the objective I’ve held for many years is now within sight. Credits for photographic sources are listed at the bottom of the page.

    The quality of reconstruction varies due to the quality and source of the underpinning materials – for instance, some image sets from 2002 were shot on a digital camera at 1600 x 1200 px resolution; later ones at 5472 x 3638 px – so the resolution is quite variable. This broadly matches the development of digital camera technology over the last 20+ years. Interesting possibilities arise with ‘up-rezzing’ source images using generative AI models, at the risk of introducing confabulated detail. It’s a trade-off between digital ‘accuracy’ and novel possibilities for generative reconstruction. Of course, I am aided by having personal experience of working at the site and witnessing its changes over many years.

    Similarly, as the conditions at the site are very variable, creating a representative 3D model is quite challenging. For instance, photographs taken in 2006 (Simon Mossman) reveal the Huts to be almost entirely entombed in ice (yes, ice, not snow), whereas conditions in 2021 (Dave Killick) revealed the structure to be almost standing free from the surrounding rocks.

    Mawson’s Huts – iced-in. 2006. Photo courtesy Simon Mossman.Mawson’s Huts, Photogrammetric Reconstruction 2024. 2021 image source courtesy of Dave Killick.Mawson’s Huts, Photogrammetric Reconstruction 2024. 2021 image source courtesy of Dave Killick.

    Similarly, the interior of the main hut has had massive amounts of ice removed over the years – thanks to ongoing conservation expeditions by the Mawsons Huts Foundation – transforming its appearance – and revealing many of the treasures previously entombed within. I hope to eventually be able to create a gradual ‘reveal’ demonstrating the amazing conservation work that has been undertaken by the talented archaeologists, materials conservators and heritage carpenters who have worked there.

    Of course, it would be wonderful to be able to return to the site myself with a very high quality full-frame or medium format camera and shoot everything at 100-200 megapixels, or in lieu of that, to have team capacity to do the job in a technically correct way.

    https://youtu.be/WFI99d96qX4?si=VW9cXExx37AGekUH

    In addition to my own extensive materials (2006/7 and 2009/10), I’m very grateful to for the photographic work of Adrian Welke (2002), Simon Mossman (2006), Chris Henderson (2009/10), Sally Hildred (2016), and Dave Killick (2021). I’m always on the lookout for more – so if you’re reading this and have some good photographic documentation – please drop me a line. Hopefully, in future expeditions we can arrange a thorough photogrammetric survey. In the meantime, I’ll keep plugging away with what I have, figuring out new ways of doing things with it – that’s half the fun.

    https://www.petermorse.com.au/2024/11/reconstructing-mawsons-huts-antarctica/

    #antarctica #gaussiansplat #gsplat #mawsonSHuts #photogrammetry #visualisation

  9. New Gaussian Splat: The Maisonneuve Monument, dedicated to the founding of Montréal in 1892.

    It attracts many onlookers and tourist groups every few minutes who like to get right in front of it. Good thing a Gaussian Splat recording can be paused temporarily.

    Explore the Splat on Scaniverse:
    scaniverse.com/scan/pcjloz7wyt

    About the monument itself:
    en.wikipedia.org/wiki/Maisonne

    #3D #gaussiansplat #cgi #shotoniPhone #scanning

  10. It seems like Google searches for "eyes hurting" soared after the Eclipse.

    Luckily my eyes didn't hurt, probably because I was busy Gaussian Splatting the gigantic (and functional) Eclipse Glasses installed by Cirque du Soleil in Montreal.

    Amazed that we can now generate Gaussian Splats using only an iPhone, with everything processed on-device

    You can explore the Splat yourself on Scaniverse scaniverse.com/scan/o5yo64qzpo

    #3d #scanning #niantic #nianticlabs #gaussiansplat
    #gaussiansplatting

  11. I've been using #Scaniverse for fun once or twice, but I'm planning to use it for the next #vfx set supervision task. It exports usdz and you have a textured model of the set for measurements. It does #GaussianSplat now but a first test turned out way more low-quality than these demos:

    blog.scaniverse.com/scaniverse

  12. I've finally implemented Gaussian splat's .splat format in polyform, and in turn, added splat support to the viewer. So now you can do things like edit Gaussian splats right in the web browser. This is an example of me cropping my family out of their kitchen and making their heads twice as large.

    All code in the video can be found here (a dev branch as I complete the node system):
    github.com/EliCDavis/polyform/

    #threejs #gaussiansplat

  13. An experiment in revisiting footage I shot whilst working as a conservation expeditioner at Mawson's Huts, #Antarctica in 2009-10. NeRFs and Gaussian Splatting enable novel ways of interrogating databases of images and video in unprecedented detail, enabling new insights into heritage and remote sites. Digital heritage is as significant as physical heritage. Of course, there’s no reason this can’t now be rendered #stereoscopically, for #fulldome or #XR devices, especially with #generative fill trained on #loras.
    www.petermorse.com.au
    #nerf #gaussiansplat #digitalheritage #archaeology #xr #omniverse - and more fun! 🙂
    www.petermorse.com.au
    youtu.be/qpiBQXwFGnY?si=zloBEP

  14. H.M.S. Endurance – gaussian splat interface (SIBR viewer)

    This page will host my experiments with Gaussian-splatting pipelines. I finally found some time to get round to setting up the environment – pretty straight-forward stuff – and a lot of emergent integrations that are worth exploring.

    H.M.S. Endurance

    My first test is based on the H.M.S. Endurance NeRF work I explored a few months ago. First impressions are that it is much less ‘instant’ – more processing time – but gives much more user-friendly interactive results. Framerates are high, floaters are largely eliminated – and will hopefully be much easier to remove. I’ll post some more examples below as I work out some pipelines – I have a few interesting experiments in mind.

    4k #gaussiansplat test of Shackleton’s Endurance. This is rendered from NerfStudio and uprezzed via Topaz VideoAI to a 60fps loop. Needs a lot more work, obviously, but the results are extremely promising and indicate that one can undertake novel #archaeological observations on trained models based on #underwater #video #drone #submersible data. A key step would be to preprocess using e.g. cnn deconvolution or physics-based approaches like the see-thru algorithm (https://lnkd.in/gE_44fzE ). Public Source data: https://endurance22.org
    One can think of all sorts of interesting applications for e.g. benthic trawl videos and volumetric reconstruction of sea-floor communities, archaeological surveys of submerged ancient cities, inspecting dams and lakes…

    S.Y. Endurance Unreal Engine Cinematic

    A #gaussiansplat #visualization #cinematic proof-of-concept in #unrealengine5 of the stern of Ernest Shackleton’s famous ship S.Y. Endurance. The wreck was discovered by Mensun Bound and the Endurance22 expedition – a remarkable achievement (read about it @ wikipedia https://en.wikipedia.org/wiki/Endurance_(1912_ship). The original render is 2.39:1 Prores 422 at 3840 x 1608 . I’ve added 35mm grain in the vain hope that YouTube compression won’t entirely wreck it. I’m happy with it for a long afternoon’s work of what I think of as ‘YouTube Marine Archaeology’ – version 0.1. Lots more can be done, obviously. Note that this is entirely unrealistic – artistic license apparently allows tropical fish to exist over 3000m below the surface of the Weddell Sea off Antarctica. [irony] We can regard these as an invasive species [/irony]. It is deliberately slow, because it’s a visualization – it’s about looking, a sense of what it would be like to be there in person in the aphotic zone, in complete darkness, where sunlight never reaches. For those interested in technical details I’ll add some more soonish. Music by Glenn Rogers #marinearchaeology #archaeology #ernestshackleton #envisioningantarctica

    Mawson’s Huts, Antarctica

    An experiment in revisiting footage I shot whilst working as a conservation expeditioner at Mawson’s Huts, #Antarctica in 2009-10. NeRFs and Gaussian Splatting enable novel ways of interrogating databases of images and video in unprecedented detail, enabling new insights into heritage and remote sites. Digital heritage is as significant as physical heritage. Of course, there’s no reason this can’t now be rendered #stereoscopically, for #fulldome or #XR devices, especially with #generative fill trained on #loras.
    #nerf #gaussiansplat #digitalheritage #archaeology #xr #omniverse

    https://www.petermorse.com.au/2023/10/gaussian-splatting-experiments/

    #archaeology #cinematic #envisioningantarctica #ernestshackleton #gaussianSplat #gaussiansplat #marinearchaeology #unrealengine5 #visualization

  15. H.M.S. Endurance – gaussian splat interface (SIBR viewer)

    This page will host my experiments with Gaussian-splatting pipelines. I finally found some time to get round to setting up the environment – pretty straight-forward stuff – and a lot of emergent integrations that are worth exploring.

    H.M.S. Endurance

    My first test is based on the H.M.S. Endurance NeRF work I explored a few months ago. First impressions are that it is much less ‘instant’ – more processing time – but gives much more user-friendly interactive results. Framerates are high, floaters are largely eliminated – and will hopefully be much easier to remove. I’ll post some more examples below as I work out some pipelines – I have a few interesting experiments in mind.

    https://youtu.be/WwqsNIzJJzc

    4k #gaussiansplat test of Shackleton’s Endurance. This is rendered from NerfStudio and uprezzed via Topaz VideoAI to a 60fps loop. Needs a lot more work, obviously, but the results are extremely promising and indicate that one can undertake novel #archaeological observations on trained models based on #underwater #video #drone #submersible data. A key step would be to preprocess using e.g. cnn deconvolution or physics-based approaches like the see-thru algorithm (https://lnkd.in/gE_44fzE ). Public Source data: https://endurance22.org
    One can think of all sorts of interesting applications for e.g. benthic trawl videos and volumetric reconstruction of sea-floor communities, archaeological surveys of submerged ancient cities, inspecting dams and lakes…

    S.Y. Endurance Unreal Engine Cinematic

    https://www.youtube.com/watch?v=FBf9OBygowI

    A #gaussiansplat #visualization #cinematic proof-of-concept in #unrealengine5 of the stern of Ernest Shackleton’s famous ship S.Y. Endurance. The wreck was discovered by Mensun Bound and the Endurance22 expedition – a remarkable achievement (read about it @ wikipedia https://en.wikipedia.org/wiki/Endurance_(1912_ship). The original render is 2.39:1 Prores 422 at 3840 x 1608 . I’ve added 35mm grain in the vain hope that YouTube compression won’t entirely wreck it. I’m happy with it for a long afternoon’s work of what I think of as ‘YouTube Marine Archaeology’ – version 0.1. Lots more can be done, obviously. Note that this is entirely unrealistic – artistic license apparently allows tropical fish to exist over 3000m below the surface of the Weddell Sea off Antarctica. [irony] We can regard these as an invasive species [/irony]. It is deliberately slow, because it’s a visualization – it’s about looking, a sense of what it would be like to be there in person in the aphotic zone, in complete darkness, where sunlight never reaches. For those interested in technical details I’ll add some more soonish. Music by Glenn Rogers #marinearchaeology #archaeology #ernestshackleton #envisioningantarctica

    Mawson’s Huts, Antarctica

    https://youtu.be/qpiBQXwFGnY?si=Opd9PzeeanKnqpcx

    An experiment in revisiting footage I shot whilst working as a conservation expeditioner at Mawson’s Huts, #Antarctica in 2009-10. NeRFs and Gaussian Splatting enable novel ways of interrogating databases of images and video in unprecedented detail, enabling new insights into heritage and remote sites. Digital heritage is as significant as physical heritage. Of course, there’s no reason this can’t now be rendered #stereoscopically, for #fulldome or #XR devices, especially with #generative fill trained on #loras.
    #nerf #gaussiansplat #digitalheritage #archaeology #xr #omniverse

    https://www.petermorse.com.au/2023/10/envisioning-antarctica-gaussian-splatting-experiments/

    #archaeology #cinematic #envisioningantarctica #ernestshackleton #gaussianSplat #gaussiansplat #marinearchaeology #unrealengine5 #visualization

  16. 🎨 WTF is a Gaussian Splat!?!?! -> A new #3DArtist Newsletter 🤖

    Seriously...am I crazy or did I blink and Gaussian Splat videos were everywhere?!?!

    So I spent my evenings last week looking into them and uncovering some of their 20-year history. Dig in with me for this week's article.

    🔗 open.substack.com/pub/3dartist

    #3d #3dart #render #cg #cgi #vfx #gaussiansplat #nerfs #gsplat #mastoart