Make-A-Character: High Quality Text-to-3D Character Generation within
  Minutes

Jianqiang Ren; Chao He; Lin Liu; Jiahao Chen; Yutong Wang; Yafei Song; Jianfang Li; Tangli Xue; Siqi Hu; Tao Chen; Kunkun Zheng; Jianjing Xiang; Liefeng Bo

Paper · arXiv 2312.15430

Make-A-Character: High Quality Text-to-3D Character Generation within Minutes

Jianqiang Ren, Chao He, Lin Liu, Jiahao Chen, Yutong Wang, Yafei Song, Jianfang Li, Tangli Xue, Siqi Hu, Tao Chen, Kunkun Zheng, Jianjing Xiang, Liefeng Bo

28 upvotesDecember 24, 2023arXiv 预印本

AI 摘要

The Make-A-Character (Mach) framework uses large language and vision models to create realistic, 3D avatars from text descriptions efficiently, enabling customization and seamless integration with existing CG pipelines.

large language modelslarge vision modelstextual intention understandingintermediate image generationhuman-oriented visual perception3D generation modules3D avatars

Abstract

There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.