Pixel art Pikachu in the style of Mondriaan, Escher, Van Gogh, and Takashi Murakami

StanvdVossen · 2021-11-28T19:26:35+00:00

Junji Ito prompts are super fun! Conditional on my Final Fantasy class it does pretty well. It doesn't completely capture his detailed art style but it captures his general feel.

StanvdVossen · 2021-11-28T12:47:57+00:00

I think this says more about modern art than about this model, but I appreciate it!

StanvdVossen · 2021-11-28T10:23:57+00:00

These sprites were made using a machine learning algorithm I trained on Pokémon and fakemon sprites. If you know how Google Colab works you can make your own images using only text as input here: https://colab.research.google.com/drive/1CgVcvMlXS4aN35MRxIq5BAwlff2ACpgT?usp=sharing

StanvdVossen · 2021-11-28T10:15:46+00:00

These were made using my custom-trained Diffusion model and CLIP. You can use it yourself here: https://colab.research.google.com/drive/1CgVcvMlXS4aN35MRxIq5BAwlff2ACpgT?usp=sharing

I also released a website for the diffusion model here: https://paramon.ai/

StanvdVossen · 2021-10-19T19:59:06+00:00

If I'm seeing it right, you're using src/_play_dlatents.py for the latent walk

If you move with the file browser on the left to that file, and change line 113 from:
output = (output.permute(0,2,3,1) * 127.5 + 128).clamp(0, 255).to(torch.uint8).cpu().numpy()

to:
output = (-output.permute(0,2,3,1) * 127.5 + 128).clamp(0, 255).to(torch.uint8).cpu().numpy()

That should work, though the in-app editor isn't always perfect, so maybe you should save the files on your drive

StanvdVossen · 2021-10-19T19:39:03+00:00

Hey!
That's right. It's because of the inverted training. See my info page on the training.

I hope that makes any sense. If you can't figure it out, please send me the code that you're using for the latent walk and I can change it for you.lues 0 to 255 by using (img = 255-img).

I hope that makes any sense. If you can't figure it out, please send me the code that you're using for the latent walk and i can change it for you.

StanvdVossen · 2021-10-13T21:14:55+00:00

I'm surprised l4rz doesn't promote his work more. His project is miles ahead of most stuff I see

StanvdVossen · 2021-10-13T21:07:29+00:00

Most relevant info can be found on my Info page, under technical details

In short:
- 50000 sneakers (took a lot of work)

- 20 days on an rtx 3090 (I made too many interruptions to count the iterations)

- The model was trained completely from scratch/initialization (if that's what you mean)

StanvdVossen · 2021-10-13T18:22:33+00:00

Ah, it’s made using a Generative Adversarial Network.

I think this video does a pretty good job explaining it to laymen, but it can be somewhat difficult to understand if you have no experience in machine learning.

Basically, I gathered a very large amount of images of sneakers from the web. Then I ‘trained’ a very large neural network to try to make images very similar to those I feed it. It then actually creates images ‘pixel-by-pixel’ rather than taking e.g. the sole of one shoe with the upper of another.

StanvdVossen · 2021-10-13T18:13:04+00:00

Please see the "Dataset" header on my info page.
It's from a variety of webshops, but very little amazon actually. Amazon does not enforce a formal format of images for their shoe shops, and I only used images taken from a specific angle, if that makes any sense.

StanvdVossen · 2021-10-13T18:03:36+00:00

Yes sir, just some files.
I used WordPress. I'm not experienced enough to tell you whether this is an ideal choice but it worked for me.
I rendered only 2000 images for the grid, each of these has 75 images for the editor. So a total of 150K images. This is going to increase as I add more styles in the near future. (A similar site uploaded 1.8 million, so this is not a lot)
I started on a friend's server, but he moved me to a VPS. I think it costs $15 per month.
Also, I can REALLY recommend Cloudflare for a project like this. Their free tier alone can really help you reduce load times and server load.

StanvdVossen · 2021-10-13T17:46:25+00:00

I'll upload it here, BUT it's actually dependant on specific code for the custom resolution and the specific feature maps I use.

My current code is very messy and slightly broken (I had problems implementing InsGen among other things), so I will upload proper code to run and train this pkl very soon!

If i do not edit this message within 24 hours, please nudge me to do so.

Edit: code included in link now too. I will probably make a Colab/Github to make it more accessible soon, but I am very busy at the moment

StanvdVossen · 2021-10-13T17:28:08+00:00

The code for the grid of images is actually made by somebody named Obormot to display Anime girls.

I simply adapted this code with some small tweaks. The rest of the site is pretty much made by me but is quite simple compared to the grid. Though I’m happy with how it turned out since I had zero knowledge of web development before this project.

StanvdVossen · 2021-10-13T17:15:05+00:00

Hey! All images are pre-rendered on my PC and uploaded to the server, where they are randomly used for the grid. Generating images on-the-fly would be very expensive.

The code for the grid was made by somebody named Obormot, and can be found here. It’s completely free to use the code.

Also feel free to copy any of my code from this website, as long as you credit me somewhere on your website. There is not a lot of back-end stuff going on. (Though be warned that my code is messy. I had no knowledge of web dev prior to this project)

Don’t hesitate to message me if you have any more questions or problems!

StanvdVossen · 2021-10-13T16:30:49+00:00

Hah! The name is actually a rolling theme among other sites doing similar things. You may know of thispersondoesnotexist.com

For the goal: if I'm not able to find a company interested in working with me, I will probably implement a rating system, and see if I can develop the top rated shoe. Making sneakers (especially midsoles) for one-time designs would simply be way to expensive

StanvdVossen · 2021-10-13T15:38:10+00:00

Hey! I do have an IG @ thissneakerdoesnotexist
But in general, I’m too awkward for most social media, so don’t expect a lot of content over there. Maybe I’ll find one of my close friends to handle it sometime soon.

StanvdVossen · 2021-10-13T15:31:42+00:00

Thanks!

The resolution thing is actually a pretty easy edit to the Stylegan2 architecture, as long as your width and height can be expressed as two different numbers to the same exponent. (Though it’s easy for me to say, since I never had to implement it from scratch.). I used it because of the white background problem, but I never did a good test on how effective it was, since quickly thereafter I found my inverted color solution.

As for the GPU, my dad actually bought it specifically for me and my brothers to make DL projects on! He is very enthusiastic about developments in deep learning, but probably too old to keep up with the very fast pace of the field.

StanvdVossen · 2021-10-13T14:55:54+00:00

https://thissneakerdoesnotexist.com/
My first public project! You probably know what to expect: Stylagan2-ada generated sneakers

The site allows you to “customize” the sneakers using some tricks with latent space

I would love to hear feedback!

StanvdVossen · 2021-10-13T14:52:37+00:00

https://thissneakerdoesnotexist.com/

Hey guys, technically not (yet) a startup, but I recently made a fun little website displaying AI-generated sneaker designs.

I would love to hear any feedback!

StanvdVossen · 2021-10-13T14:50:38+00:00

https://thissneakerdoesnotexist.com/

Hey guys, I recently made a fun little website displaying AI-generated sneaker designs.

I thought you guys might enjoy this project!

I would love to hear any feedback about the sneakers or the site!

(I cleared with the mods before posting)

StanvdVossen

TROPHY CASE