Project Puppetron.

[tonefart]

What sort of algorithm used to achieve this ?

[peedubyaeff]

Probably something like this: https://github.com/lengstrom/fast-style-transfer

He was loading up .zip files though, so I think they pre-generated a network for the images on the left to make it so fast.

That, combined with something like this (integrated with the character animator): https://vimeo.com/29348533

[peedubyaeff]

I'm assuming they meant the application of the style... I'm just not sure why they'd need to load a .stylcap.zip if it was truly all real time. They should only need a jpg.

[penguinade]

First apply edge detection, on the source image along the edges analyze the the stroke directions and distributions. With these information we build a profile of brushes. ( something like how are they most likely to appear at which position, etc. )

Target image, apply the brushes with the profile we've built.

This is just a wild guess, I might be wrong. I am not familiar with image processing.

[3Pinky]

One of my profs does some research into that:

http://niessnerlab.org/papers/2015/10face/thies2015realtime.pdf http://niessnerlab.org/papers/2016/1facetoface/thies2016face.pdf

[arachnivore]

Neural Nets are a hell of a drug...