IllumiNeRF: 3D Relighting with No Inverse Rendering, Switch Any Lighting Effect Freely

The research team proposed a simpler approach, IllumiNeRF: first, a diffusion model under specific lighting conditions is used to relight each input image, and then these relighted images are used to reconstruct a Neural Radiance Field (NeRF) to present new perspectives under the target lighting. They demonstrated that this strategy is surprisingly competitive and achieved state-of-the-art results in several relighting benchmarks.