Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

[Another recent "style transfer with brushstrokes" paper from my colleagues in Heidelberg University ]

In this paper, images are stylized by optimizing parameterized brush strokes instead of pixels as well. In order to backpropagate teh error through the rendered brushstrokes, the authors came up with a simple differentiable rendering of strokes, each of which is parameterized with a Bezier curve.

The results are excellent. You can also add constraints to the shape of your brush strokes by drawing a couple of lines over the photo. The only drawback is that it works for a rather long time (10-20 minutes per 1MP picture), since this is an iterative optimization, and at each iteration a forward-pass through VGG-16 newtwork is required.

🌀 Project website
🛠 Source code

Gradient Dude

This media is not supported in your browser

VIEW IN TELEGRAM

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

[Another recent "style transfer with brushstrokes" paper from my colleagues in Heidelberg University ]

In this paper, images are stylized by optimizing parameterized brush strokes instead of pixels as well. In order to backpropagate teh error through the rendered brushstrokes, the authors came up with a simple differentiable rendering of strokes, each of which is parameterized with a Bezier curve.

The results are excellent. You can also add constraints to the shape of your brush strokes by drawing a couple of lines over the photo. The only drawback is that it works for a rather long time (10-20 minutes per 1MP picture), since this is an iterative optimization, and at each iteration a forward-pass through VGG-16 newtwork is required.

🌀 Project website
🛠 Source code

hottg.com/gradientdude/328

5.9K viewsAug 11, 2021 at 07:00