Sanakoyeu et al 2018 - guillaumedescoteauxisabelle/ma-biblio GitHub Wiki

A Style-Aware Content Loss for Real-time HD Style Transfer

ZotWeb article-journal
Src Url Sanakoyeu, Kotovenko, Lang, Ommer (2018)

Abstract

Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single image or an artist, but previous work is limited to only a single instance of a style or shows no benefit from more images. Moreover, previous work has relied on a direct comparison of art in the domain of RGB images or on CNNs pre-trained on ImageNet, which requires millions of labeled object bounding boxes and can introduce an extra bias, since it has been assembled without artistic consideration. To circumvent these issues, we propose a style-aware content loss, which is trained jointly with a deep encoder-decoder network for real-time, high-resolution stylization of images and videos. We propose a quantitative measure for evaluating the quality of a stylized image and also have art historians rank patches from our approach against those from previous work. These and our qualitative results ranging from small image patches to megapixel stylistic images and videos show that our approach better captures the subtle nature in which a style affects content.


Annotations

A Style-Aware Content Loss for Real-time HD Style Transfer

Citer: (Sanakoyeu et al., 2018)

FTag: Sanakoyeu-et-al-2018

APA7: Sanakoyeu, A., Kotovenko, D., Lang, S., & Ommer, B. (2018). A Style-Aware Content Loss for Real-time HD Style Transfer. _ArXiv:1807.10201 [Cs] _. http://arxiv.org/abs/1807.10201

style transfer has received a lot of attent

[...] much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single image or an artist, but previous work is limited to only a single instance of a style or shows no benefit from more image.  (Sanakoyeu et al., 2018)
NSTProblematic

[...] pre-trained on ImageNet, [...] can introduce an extra bias, since it has been assembled without artistic consideration.  (Sanakoyeu et al., 2018)
NSTProblematic

To circumvent these issues, we propose a style-aware content loss, which is trained jointly with a deep encoder-decoder network for real-time, high-resolution stylization of images and video

Style transfer, generative network, deep learning

#keywords
NSTKeywords

Project page: https://compvis.github.io/adaptive-style-transfer .
NSTReferences

Extra Qualitative Results

Altering the style of an existing artwork Our method is able to change the style of an existing artwork, rendering it in another style. It means, that our algorithm can also handle content images which are artistic, which, to our knowledge, was never shown in previous work before. We refer the reader to the results on the project page.



⚠️ **GitHub.com Fallback** ⚠️