Readme.md (Perfect branch) - SunnerLi/RecycleGAN GitHub Wiki

Re-cycle GAN

The Re-implementation of Re-cycle GAN Idea

Packagist Packagist Packagist Packagist

Branch Explain

This branch remains the perfect rendered result. However, compare to the correct version of RecycleGAN, there is one big difference. During updating the generator, the adversarial loss is not conducted. You can use the code in this branch to re-produce the result which is shown below.

Usage

The detail can be found in here. But you should download the dataset from the following link.

https://drive.google.com/drive/folders/1mmWND9ZLK9nZwa8lMQWOVjN5sU_rrWD0?usp=sharing

And you can simply use the following command:

# For training
$ python3 train.py --A <domain_A_path> --B <domain_B_path> --T 3 --resume result.pkl --record_iter 500 --n_iter 30000
# For inference
$ python3 demo.py --in <video_path> --direction a2b --resume result.pkl

Result


The above image shows the both domain. The left column is the original image in both domain. The middle column is the rendered result which adopt the linear-smoothing function in paper. The right column is the reconstruction result. In our experiment, we don't consider usual cycle-consistency loss but thinking of recycle loss.


We only show the single flower-to-flower transform result. In the first domain, the flower is composed by green stem and white bundle part, and the flower is orange in the second domain. The above GIF shows that the generator can render the whole image with fire tone, and the plant can be colored into orange.


The next marvelous example is shown above. For the opposite direction, the generator can realize the petal meaning in both domain, and render into white! Also, the stem can be remain as green. As the time extend, the flower will open with green tone. The most successful feature is that there is no discontinuous artifact between each frame in time series.

Reference

[1] A. Bansal, S. Ma, D. Ramanan, and Y. Sheikh, "Recycle-gan: Unsupervised video retargeting," arXiv preprint arXiv:1808.05174, 2018.

⚠️ **GitHub.com Fallback** ⚠️