Tomoyuki Suzuki, Kotaro Kikuchi, Kota Yamaguchi
This paper presents an approach to decomposing animated graphics into
sprites, a set of basic elements or layers. Our approach builds on the
optimization of sprite parameters to fit the raster video. For efficiency, we
assume static textures for sprites to reduce the search space while preventing
artifacts using a texture prior model. To further speed up the optimization, we
introduce the initialization of the sprite parameters utilizing a pre-trained
video object segmentation model and user input of single frame annotations. For
our study, we construct the Crello Animation dataset from an online design
service and define quantitative metrics to measure the quality of the extracted
sprites. Experiments show that our method significantly outperforms baselines
for similar decomposition tasks in terms of the quality/efficiency tradeoff.