Have been throwing CC-licensed drone videos through Polycam’s implementation of Gaussian splatting.
With about 100 resized frames selected from this: https://commons.wikimedia.org/wiki/File:Mistail,_aerial_video.webm
It gives this: https://poly.cam/capture/1b6abb91-bf29-4a1b-9483-678f8749073d
@vruba A missed opportunity to call this technique AIrbrushing.
@sgillies Pretending I didn’t see this.
@vruba The transparency effect you get from, i guess they're splats (?), is really effective. VR painting apps do something similar with brushstrokes in 3d space. I think i just found my rabbit hole for this week.
@vruba I tried ~100 frames of a couple videos landing into Seattle and it had a really hard time. But it's beautiful! https://poly.cam/capture/3bea75b3-c6bd-4ca0-b837-c076af74a4f6 and https://poly.cam/capture/3bea75b3-c6bd-4ca0-b837-c076af74a4f6
@ian I really like the failures. (The structure-from-motion stage seems to work far better when you have views from either side, and even then it’s far from reliable.)
@ian I’ve seen that long smear failure mode a lot, and also a flat state where it basically paints one photo in 2D with minimal texture. Here’s an example, to be deleted in like 30 seconds: https://poly.cam/capture/06c0ac93-0719-4a45-acf6-a86170700eed
For the curious, here’s a nice writeup of how this works – it’s a fun combination of multi-decade–old ideas, “standard” structure-from-motion, and tricks that are inspired by (but not directly based on) the current GPU and neural network boom: https://aras-p.info/blog/2023/09/05/Gaussian-Splatting-is-pretty-cool/