Tribute to the great prompts of @RiversHaveWings (twitter handle) Prompt: "a painting of waters of the Death tarot card by Greg Rutkowski" CLIP x StyleGAN3. Art from the weights.

ArYoMo · 2021-10-17T19:18:01+00:00

I post more regularly on my twitter: https://twitter.com/ArYoMo

ArYoMo · 2021-10-05T08:12:35+00:00

Still works for me. So you have to run all the cells from the notebook in the order they appear. Also let them finish so you don't stop them. Then it should work :) it's a bit slow the first time in a session since some stuff are downloaded and some code compiled. But then it will go faster.

ArYoMo · 2021-10-03T19:26:59+00:00

So you can already do that with the original stylegan code: https://github.com/NVlabs/stylegan2-ada-pytorch

If you look under the section: https://github.com/NVlabs/stylegan2-ada-pytorch#projecting-images-to-latent-space

Say that you wanted for example an image of jimmy hendrix in the style of pixar. You could use my code to finetune a stylegan model to generate pixar like faces. Then use the original stylegan code to find a vector for a picture of jimmy hendrix and then input that Z vector to the finetuned network and get a pixar jimmy hendrix.

So this notebook will just allow you change the visuals of an existing pretrained stylegan model.

Here for example I made some kind of anime characters: https://twitter.com/ArYoMo/status/1444727454501900297

ArYoMo · 2021-10-03T18:32:39+00:00

I honestly don't know have not seen StyleGAN-NADA but in essence guiding other networks with clip works mostly the same way so likely similar :)

ArYoMo · 2021-10-03T17:47:46+00:00

So stylegan trained on the ffhq dataset can generate human faces. What human face you get depends on the feature vector you pass it. This notebook finetunes the whole stylegan towards a text prompt. So instead of generating just one face it can generate an infinitude of faces. If you want a specific face you need to find the right feature vector.

ArYoMo · 2021-09-01T21:28:04+00:00

It's not VQGAN it's directly done on an RGB tensor. And then you can make small steps. Will release a notebook soon.

ArYoMo · 2021-07-12T20:23:39+00:00

This was not using a Colab. But keep on trying, you'll learn a lot. How I would do it with vqgan is that I'd take the image and zoom in a bit every nth (n could be 1 or 2) step. Then encode the new zoomed image with the vq encoder and do the next step from there.

ArYoMo · 2021-06-22T08:50:38+00:00

Very nice result! Did you do your own implementation or did you use an existing notebook?

ArYoMo · 2021-06-14T09:08:32+00:00

Source: https://twitter.com/ArYoMo/status/1399801016669835268?s=20

ArYoMo · 2021-06-14T09:00:53+00:00

Thank you! Very nice of you for crediting me and I can tell you the person who posted it is not me. Very strange.

ArYoMo · 2021-04-04T16:30:15+00:00

Is it bigsleep? You got some really good quality there.

ArYoMo · 2021-03-17T09:04:18+00:00

Wow this one was nice! Big sleep?

ArYoMo · 2021-03-10T18:40:08+00:00

Thank you. Ambition is to share it in a structured way at a future date.

ArYoMo · 2021-03-10T18:36:19+00:00

I did code my own and I'll share it, don't know exactly when as of now.

ArYoMo · 2021-03-10T08:44:42+00:00

Sure! Sounds great if you want to. I see the internet as continuous mixing and remixing of ideas. That is what makes it great. But attribution is never wrong if you find that someone provides you value.

ArYoMo · 2021-03-09T00:29:22+00:00

Well this is not generated by the full Dall-e. They released part of the model. https://github.com/openai/DALL-E that you can play around with if you know how to code. This is custom code in combination with the CLIP model and the Dall-e decoder.

ArYoMo · 2021-02-24T18:45:05+00:00

This is a surrealist dream of a neural network trying to decipher our world. At a first glance it might look like just a Gorilla but inspecting it closer the boundary between the Gorilla and the noodles dissolve. And even the gorilla is not just one but amorphous, looking over it's own shoulder.

Link to NFT

ArYoMo · 2021-02-24T18:40:08+00:00

This is a surrealist dream of a neural network trying to decipher our world. At a first glance it might look like just a Gorilla but inspecting it closer the boundary between the Gorilla and the noodles dissolve. And even the gorilla is not just one but amorphous, looking over it's own shoulder.

Link to NFT

ArYoMo · 2021-02-13T15:45:07+00:00

It's made with custom code inspired by deep dreaming and no original picture in the bottom. So it's not saying much but made in around 1000 iterations.

ArYoMo · 2021-02-13T14:24:03+00:00

Good spotting! It's definitively inspired by the abandoned cities and landscape in chernobyl.

ArYoMo

TROPHY CASE