NeRFs use neural networks to represent and render realistic 3D scenes based on an input collection of 2D images.Ĭollecting data to feed a NeRF is a bit like being a red carpet photographer trying to capture a celebrity’s outfit from every angle - the neural network requires a few dozen images taken from multiple positions around the scene, as well as the camera position of each of those shots. In a tribute to the early days of Polaroid images, NVIDIA Research recreated an iconic photo of Andy Warhol taking an instant photo, turning it into a 3D scene using Instant NeRF. Showcased in a session at NVIDIA GTC this week, Instant NeRF could be used to create avatars or scenes for virtual worlds, to capture video conference participants and their environments in 3D, or to reconstruct scenes for 3D digital maps. “In that sense, Instant NeRF could be as important to 3D as digital cameras and JPEG compression have been to 2D photography - vastly increasing the speed, ease and reach of 3D capture and sharing.” “If traditional 3D representations like polygonal meshes are akin to vector images, NeRFs are like bitmap images: they densely capture the way light radiates from an object or within a scene,” says David Luebke, vice president for graphics research at NVIDIA.
#Nerf white out plus#
The model requires just seconds to train on a few dozen still photos - plus data on the camera angles they were taken from - and can then render the resulting 3D scene within tens of milliseconds. The result, dubbed Instant NeRF, is the fastest NeRF technique to date, achieving more than 1,000x speedups in some cases. NVIDIA applied this approach to a popular new technology called neural radiance fields, or NeRF. The NVIDIA Research team has developed an approach that accomplishes this task almost instantly - making it one of the first models of its kind to combine ultra-fast neural network training and rapid rendering.
Known as inverse rendering, the process uses AI to approximate how light behaves in the real world, enabling researchers to reconstruct a 3D scene from a handful of 2D images taken at different angles. Today, AI researchers are working on the opposite: turning a collection of still images into a digital 3D scene in a matter of seconds. When the first instant photo was taken 75 years ago with a Polaroid camera, it was groundbreaking to rapidly capture the 3D world in a realistic 2D image.
0 kommentar(er)
