Neuralangelo adopts instant neural graphics primitives, the technology behind NVIDIA Instant NeRF, to help capture these finer details. Prior AI models to reconstruct 3D scenes have struggled to accurately capture repetitive texture patterns, homogenous colors and strong color variations. Neuralangelo can also reconstruct building interiors and exteriors - demonstrated with a detailed 3D model of the park at NVIDIA’s Bay Area campus. In a demo, NVIDIA researchers showcased how the model could recreate objects as iconic as Michelangelo’s David and as commonplace as a flatbed truck.

“This tool will eventually enable developers to import detailed objects - whether small statues or massive buildings - into virtual environments for video games or industrial digital twins.” “The 3D reconstruction capabilities Neuralangelo offers will be a huge benefit to creators, helping them recreate the real world in the digital world,” said Ming-Yu Liu, senior director of research and co-author on the paper. The high fidelity makes its 3D reconstructions easier for developers and creative professionals to rapidly create usable virtual objects for their projects using footage captured by smartphones. Neuralangelo’s ability to translate the textures of complex materials - including roof shingles, panes of glass and smooth marble - from 2D videos to 3D assets significantly surpasses prior methods.

Creative professionals can then import these 3D objects into design applications, editing them further for use in art, video game development, robotics and industrial digital twins. Like Michelangelo sculpting stunning, life-like visions from blocks of marble, Neuralangelo generates 3D structures with intricate details and textures.

Neuralangelo, a new AI model by NVIDIA Research for 3D reconstruction using neural networks, turns 2D video clips into detailed 3D structures - generating lifelike virtual replicas of buildings, sculptures and other real-world objects.

Download phantasmagoria 1