Nvidia Instant NeRF (Images to 3D scene)

[Melooon]

This probably deserves a longer topic, but Iv been messing around with Nvidias 3D rendering system recently and figured Id share it here for anyone interested!


This is a render I made of my dad while he was sitting in a local cafe. It has a mesh overlay to make it more obscure and arty; the meshes can be exported as 3D models, but the detailed textures you seen in the background cannot which is a bit of a pain. That said, Im working on an arts project atm and im super pleased with this process and will prob include a few of these renders

The project itself is a bit of a chore to setup; its open source but you need an Nvidia GPU in your computer and you need to compile the project from source: There is a pretty good tutorial here: https://github.com/bycloudai/instant-ngp-Windows

Watch the video they link at the top; just install everything (Also install GIT they forget that) and follow the steps; and when it asks for a data set; you literally just take about 20-100 photos of the thing you want to make a 3d model of, from different angles; thats your data set; pop it in and bobs your uncle! (The images don't need to align like a panorama; it will figure out the connections between objects! Make sure to resize images to about 1000px or it'll be really slow)