ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural
  Radiance Fields

Edward Bartrum; Thu Nguyen-Phuoc; Chris Xie; Zhengqin Li; Numair Khan; Armen Avetisyan; Douglas Lanman; Lei Xiao

返回文献探索

Paper · arXiv 2401.17895

ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields

Edward Bartrum, Thu Nguyen-Phuoc, Chris Xie, Zhengqin Li, Numair Khan, Armen Avetisyan, Douglas Lanman, Lei Xiao

16 upvotesJanuary 31, 2024arXiv 预印本

AI 摘要

A novel text-guided 3D scene editing model replaces specific objects while maintaining 3D consistency across multiple viewpoints.

ReplaceAnything3DRAM3Dtext-guided 3D scene editingErase-and-Replace approach3D consistencymulti-view imagestext prompts

Abstract

We introduce ReplaceAnything3D model (RAM3D), a novel text-guided 3D scene editing method that enables the replacement of specific objects within a scene. Given multi-view images of a scene, a text prompt describing the object to replace, and a text prompt describing the new object, our Erase-and-Replace approach can effectively swap objects in the scene with newly generated content while maintaining 3D consistency across multiple viewpoints. We demonstrate the versatility of ReplaceAnything3D by applying it to various realistic 3D scenes, showcasing results of modified foreground objects that are well-integrated with the rest of the scene without affecting its overall integrity.