Abstract
We introduce VectorPainter, a novel framework designed for reference-guided text-to-vector-graphics synthesis. Based on our observation that the style of strokes can be an important aspect to distinguish different artists, our method reforms the task into synthesize a desired vector graphics by rearranging stylized strokes, which are vectorized from the reference images. Specifically, our method first converts the pixels of the reference image into a series of vector strokes, and then generates a vector graphic based on the input text description by optimizing the positions and colors of these vector strokes. To precisely capture the style of the reference image in the vectorized strokes, we propose an innovative vectorization method that employs an imitation learning strategy. To preserve the style of the strokes throughout the generation process, we introduce a style-preserving loss function. Extensive experiments have been conducted to demonstrate the superiority of our approach over existing works in stylized vector graphics synthesis, as well as the effectiveness of the various components of our method.
Methodology
VectorPainter comprises two main steps, Stroke Style Extraction and Stylized SVG Synthesis. In the stroke style extraction stage, VectorPainter extracts vectorized style strokes from the reference image. During the generation process, VectorPainter produces SVGs based on the style strokes extracted in the first step. A style-preserving loss is introduced to enhance the stylistic consistency of the final output SVGs.
Given a text prompt \(\mathcal{P}\) and a reference image \(\mathcal{I}_{s}\), VectorPainter optimizes the parameters \(\theta\) of the vector graphic \(\mathcal{S}\). Initially, it extracts vectorized strokes from \(\mathcal{I}_s\), which are then used to initialize the synthesis process. During synthesis, a style-preserving loss is introduced to ensure the style fidelity.
Experiments
The terms "vector" or "raster" in parentheses indicate the format of the results generated by the method. "Vector" refers to vector graphics, while "raster" refers to raster graphics.
Citation
@article{hu2024vectorpainter,
title={VectorPainter: Advanced Stylized Vector Graphics Synthesis Using Stroke-Style Priors},
author={Hu, Juncheng and Xing, Ximing and Zhang, Jing and Yu, Qian},
journal={arXiv preprint arXiv:2405.02962},
year={2024}
}
Acknowledgements
We thank Ximing Xing for providing us with the source code of the web page to help us build the project home page.