I'm always looking for movies with good tracking shots to try reconstructing in 3D. This is from 's classic "The Life Aquatic with Steve Zissou". Not perfect results, but interesting! #NeRF
Follow
Simon Green
@simesgreen
Research Engineer @ Meta / Oculus. Computer vision, graphics, NeRFs. Ex-NVIDIA.
Simon Green’s Tweets
The keyboard is still fashionable, at least.
2
Show this thread
Is this what all the cool AI researchers are using these days?
1
1
8
Show this thread
I put a tree in a room! Latest experiment: compositing one #NeRF on top of another. My compositing is rubbish, but hey! Reconstructed using
3
6
51
Show this thread
Jeez, this was 20 years ago. Still stupid! nvidia.com/docs/io/8230/g
2
1
28
Spent the last few days building this Lego with my kids, so of course I had to try doing a 3D capture! #LEGOBuildDay
1
4
88
If there’s one thing volume rendering is good at, it’s participating media!
1
6
Show this thread
20
52
386
Thanks to and for featuring some of my videos in this great intro to NeRFs for visual effects!
2
2
28
I'm not sure that re-rendering with a different camera move really counts as visual effects, but this is a promising start!
Quote Tweet
Welcome to the Luma Fields Editor (beta)!
Starting today everyone in our community can create incredible cinematic renders from all of their captures.
Try it out and give us feedback on Discord (now open!): discord.gg/tS4cT9kU
3D VFX, now for everyone! 
Show this thread
0:29
20K views
1
14
Current status: still employed.
2
56
16
38
345
3D reconstruction of reflected in the mirror pond. Impressive quality using !
10
64
Mark showed some really exciting tech today at #metaconnect2022 ! With my team , , we created the object reconstruction and rendering using neural radiance fields youtu.be/hvfV-iGwYX8?t= and can share a few more details.
5
19
90
Show this thread
6
18
96
Great to see people making NeRF tools easier to use!
Quote Tweet
After a long time in the making, it’s finally live! It’s been so fun building this with the @nerfstudioteam, and we can’t wait for what’s next. Reach out if you are curious for our future plans. 
twitter.com/akanazawa/stat…
twitter.com/akanazawa/stat…2
Interesting NeRF capture rig using 3 cameras shooting in burst mode:
Quote Tweet
R&D is experimenting with storytelling applications of Neural Radiance fields (NeRF), a machine learning technique for achieving photorealistic detail in 3D. We recently published a series of tests using this method: nyti.ms/3Sk78pP
Show this thread
0:04
28.9K views
2
17
Along the same lines, strangely satisfied to see that the RTX 3090 has 16384 shader "cores".
Quote Tweet
11Gb? I'm very suspicious of anything that has a memory capacity that isn't a power of 2. It's unnatural! twitter.com/NVIDIAGeForce/
1
10
This is a very cool system - it generates a full body pose from just the position+orientation of the headset and hands, using machine learning and a physics model. It doesn't even know where the feet are!
Quote Tweet
This paper shows some of our research at Meta Reality Labs in reconstructing a user's pose from only the sensors of the Quest headset using Reinforcement Learning.
authors: with Jungdam Won and Yuting Ye
paper: arxiv.org/abs/2209.09391
video: youtu.be/CkTHsz6Ldas
1/4
Show this thread
0:14
159.2K views
7
38
For reference, this is the input video, from which I extracted about 60 still frames. Amazing how well this works!
2
6
Show this thread
It’s pretty hard to understand what this is from Nvidia’s marketing materials - ray tracing acceleration for subdivided triangles with displacement and vertex alpha? Can anyone explain?
3
2
14
Something strange going on at the Royal Naval College in Greenwich. I'm sure there's a music video possible with this! #InstantNeRF
10
15
93
Show this thread
The One Where They Reconstructed 3D Humans and Environments in TV Shows
abs: arxiv.org/abs/2207.14279
project page: ethanweber.me/sitcoms3D/
5
85
455
Imagine a world where we can do this in real-time, and view it through AR/VR glasses.
5
14
166
Southwark Cathedral, flooded. Reconstructed in 3D using #InstantNerf from 40 iPhone photos. #InstantNeRFSweepstakes
10
71
My old shadertoy recreation of the Tron light cycle, which I probably spent way too much time on: shadertoy.com/view/Xdf3z8
1
5
Show this thread
Showing my age here, but Tron was very influential in me getting into computer graphics! It had it all - arcade games, cyberspace, AI, and Jeff Bridges!
2
2
26
Show this thread
More experiments folding space with a #NeRF reconstruction of my street. Quality isn't great, but you get what I was going for!
6
10
96
Experimenting with adding some space-warp effects to the #InstantNerf renderer. "Dr Strange" in the real world!
8
16
153
For shiny stuff like this, something like Ref-NeRF (which basically learns an environment map) would probably help a lot:
4
14
Show this thread
Instant NeRF reconstruction of an abandoned car I found on a recent trip to Bellevue, WA. Input was 260 images from iPhone video. Impressed with how well it manages to reconstruct the interior through the windows! Nice work et al.
6
27
208
Show this thread
Impressive stuff. I love the new FP8 data type, I guess it can represent any 256 of the infinite number of real numbers ... approximately? :)
3
21