JavaScript is not available.

Jan 29

Day ~36. Last month, I set out to learn the art of NeRF by building a neural renderer in CUDA, using permissively-licensed resources. I'd call it a success so far. This concludes Zero to NeRF. Stay tuned for what's next: NeRF to Infinity!

0:10

15.7K views

422

GitHub - JamesPerlman/NeRFRenderCore: A render engine for NeRFs!

Elizabeth Sampat

@twoscooters

Jan 28

Someone asked AI to make a sign language manual, in case you’re worried that we’ll all be out of a job soon

414

4,923

22.5K

300 hours logged so far. Almost ready to move on to the next part: the Blender integration. Rendering needs to be a little faster first! Here's the code in case you're interested in following along (it's MIT Licensed!):

github.com

A render engine for NeRFs! Contribute to JamesPerlman/NeRFRenderCore development by creating an account on GitHub.

I'm just getting started! Next I'll improve training and rendering speeds. This video is 3261 frames, representing exponential training steps from 0 to 8061. Resolution is 1080x1080, total processing time 7h 46m. A bit slow for today's standards but it'll get there!

1:48

713 views

Standing on the shoulders of giants doesn't even come close to what it's been like to build this. The wealth of resources and information available is simply remarkable. And it's a significant understatement to say the people researching this stuff are smart, kind, and helpful.

Something I've learned from doing this - NeRF is really hard! The hardest thing I've ever attempted. I thought there would be a "Holy shit!" moment a la original NeRF, but it's been more of a slow grind, with each run yielding ~1% higher quality than the last run (at best).

volinga.ai

@VolingaAI

Jan 26

#NeRF is the big player nowadays and in the future 3D universe, but… why #Volinga has too much to do about it? Volinga is the first company that allows rendering NeRF in Unreal Engine 💯. This demo shows a model based on nerfacto by

@nerfstudioteam

rendered in real-time.

0:18

37.1K views

448

nerfstudio

@nerfstudioteam

Jan 27

v0.1.16 Released 🎉 New Blender integration for VFX workflows! #NeRF #nerfacto #VFX #Blender3d

0:26

38.2K views

154

782

Ben Tossell

@bentossell

Jan 27

MAV3D (Make-A-Video3D) - a method for generating three-dimensional dynamic scenes from text descriptions. Using a 4D dynamic Neural Radiance Field (NeRF). project page: make-a-video3d.github.io arXiv: arxiv.org/abs/2301.11280

0:06

25.9K views

506

progress! I think I finally solved that gradient. (huge thanks to

@jon_barron

). Now it seems the occupancy grid has a problem... after the first update, about 60% of the cells are culled, but then they all come back over the next 4 occupancy grid updates... any ideas anyone?

Jan 24

Aight I know it's not a competition, but *MY* NeRF algorithm is ONLY FLOATERS today, so if that's your thing hmu. #OopsAllFloaters

Quote Tweet

Luma AI

@LumaLabsAI

Jan 24

0:27

Floaters, clouds, things... NO MORE! Announcing the next release of Luma NeRF captures: they are clearer, sharper, and even higher res. And they are here. NOW! lumalabs.ai/ios #3d #ai #nerf #capture

Show this thread

Jan 20

All of these are original renders from my shitty NeRF algorithm, the only modification is a black background. I'll admit I think some of them look pretty cool, and it's fun to use my allotment of self-deprecation for a silly post. I will figure this out. It is inevitable. :)

7. Nope, It Exploded. GG no re.

6. The Nuclear Option. Its gradients are highly explosive. The only sane step from here may be total disarmament: rm -rf /

5. Barnacle Dozer. This was left to the elements for many years, before being unearthed by a well-rendered dozer. I have yet to find the asshole (and their shiny fancy dozer) that left it here for me to look at.

4. Technodozer. The life of the party. The foam and glowstick liquid are still fresh. Unfortunately I have a strict curfew policy so this one's grounded for a month.

3. Rorschach's Dozer. If you look closely enough you can see the sanity slipping away from me.

2. The dozer of shattered dreams. Some say this was once used to excavate vast quantities of raw happiness.

Shitty dozers, an art gallery of failed NeRF renders. As I build my renderer, I continue to meet failure after failure, likely due to the fact that I don't really know shit about fuck. 1. Lavadozer. This one represents my burning desire to literally just have one good render.

121

#NeRF researcher SOS - why is this so lumpy??? and why do infinite values keep appearing in my density field? plz send help

0:19

10.8K views

Jon Barron

@jon_barron

Jan 17

Three years ago today, the project that eventually became NeRF started working (positional encoding was the missing piece that got us from "hmm" to "wow"). Here's a snippet of that email thread between Matt Tancik,

@_pratul_

@BenMildenhall

, and me. Happy birthday NeRF!

184

1,513

Jan 14

rate my bulldozer. #NeRF

mizt

@mizt_org

Jan 12

0:06

24.5K views

118

1,478

Jan 13

NeRFRenderCore repo (91% CUDA omg): github.com/JamesPerlman/N YouTube (daily updates): youtube.com/@jperldev Twitch (come say hi!) twitch.tv/jperldev Cya tomorrow :)

Zero to NeRF - Day 21. Neurly there. The radiance is so close, I can smell it. Today field good.

1:38

5.3K views

100

This is definitely debuggable, and a far cry from the very first image the network outputted just a few hours earlier. Here's that image:

Zero to NeRF Day 20 Update THE NERF IS NIGH. Training & rendering are implemented but not functional. My renderer outputs this image after 50 iters. It appears to have a periodic pattern 16 pixels wide. Interestingly the network output width is also 16... Data alignment?

YES!

Quote Tweet

Laan Labs

@laanlabs

Jan 9

Used NeRF to make a "Bullet Time" effect for a friend's wedding. We set up 15 iPhones to capture slow-motion video, then used @NVIDIAAIDev Instant-NGP to train a bunch of NeRFs on the frames. ..need to work on improving the quality / resolution a bit more.

0:19

116K views

Jan 8

Soooo this came out two days ago. AND IT IS MIT LICENSED 🤯😍🥰 I love #FacebookResearch hyperreel.github.io

117

Luma AI

@LumaLabsAI

Jan 6

✨ Today we are launching NeRF Reshoot on iOS! Capture lifelike 3D and then create incredible shots all day using AI and the most intuitive 3D editor ever, right on your iPhone. Available on the AppStore, today! apps.apple.com/us/app/luma-ai #3d #ai #nerf #lumaai

0:36

134.8K views

509

2,354

Jan 4

Still posting daily updates to YT: youtube.com/@jperldev And still streaming daily: twitch.tv/jperldev Getting closer each day! Cya tomorrow. github.com/JamesPerlman/N

et al called the volumetric rendering function "trivially differentiable" on page 6 of the original NeRF paper 😭 arxiv.org/pdf/2003.08934 Anyway I hope I did it right! I'll implement it in code tomorrow. YOLO. github.com/JamesPerlman/N

Zero to NeRF update for ya- It's day 13, I've completed data loading, batch generation, occupancy grid implementation, concatenated MLP architecture (via the Instant-NGP paper), and today I spent 9 hours computing the derivative of the loss function with respect to rgb & sigma...

0:59

8.9K views

179

The birds have spoken.

This research looks like it was so much fun, and is an amazing example of what is possible with NeRFs. Check it out! climatenerf.github.io

Quote Tweet

Jon Barron

@jon_barron

Dec 26, 2022

Merry NeRF-mas to those who celebrate! climatenerf.github.io

0:06

25.5K views

Kevin Parry

@kevinbparry

Dec 23, 2022

Stop-Motion x #NeRF! I teamed up with

to turn stop-motion animation into a 3D asset that we could track into any shot using NeRFs.

0:18

49K views

204

1,499

5/5) I will end with a failure case that happened about 30 mins later when I tried to get it to rewrite pseudocode for a camera ray generator. It didn't quite understand what to do...Going to try refining this technique but this one was faster to code the old-fashioned way. :P

4/5) This is a really fun and exciting example of human-guided AI coding, and so fun to use. In about 5 minutes I was able to write a performant multi-threaded image loader, which taught me some new techniques as well. The code works great now!