Over 15 years ago, Microsoft released Photosynth [previously], a nifty tool that could correlate dozens of photos of the same place from different angles in order to make a sort of virtual tour using photogrammetry, a technique that went on to influence google Earth's 3D landscapes and virtual reality environments. But what if you tried the same thing with cartoons? Enter Toon3D, a novel approach to applying photogrammetry principles to hand-drawn animation. The results are imperfect due to the inherent inconsistency of drawn environments, but it's still rather impressive to see a virtual camera moving around glitched-out versions of the Krusty Krab, Bojack Horseman's living room, or the train car from Spirited Away. Interestingly, the same approach works about as well on paintings or even AI-generated video; see also the similar technique of neural radiance fields (NERFs) for creating realistic high-fidelity virtual recreations of real (and unreal) environments.
posted by Rhaomi (2 comments total) 3 users marked this as a favorite