Overview
InstructNeRF2NeRF is a state-of-the-art framework for editing Neural Radiance Fields (NeRFs) using text-based instructions. Unlike traditional 3D editing which requires manual geometry or texture manipulation, this tool utilizes a 2D diffusion model (InstructPix2Pix) to iteratively refine a 3D scene. The architecture employs a unique 'Iterative Dataset Update' (IDU) method, which alternates between updating the underlying dataset of images using the diffusion model and retraining the NeRF to maintain multi-view consistency. This ensures that edits—such as changing a person's clothes, turning a landscape from summer to winter, or stylizing a room—remain spatially coherent from any camera angle. As of 2026, it remains the industry standard for researchers and VFX artists looking to bridge the gap between text-to-image generative AI and consistent 3D world-building. It is primarily built upon the Nerfstudio ecosystem, offering high modularity and support for various NeRF backbones like Nerfacto.