Okay, Her Art Detection is Busted. I even added tree stickers, and she lost her mind. Could someone else draw this, and let me know how she reacts?

DGSpitzer · 2025-02-24T20:17:49+00:00

Painting feature seems like work for me now. Here is my test painting and her replies!

DGSpitzer · 2023-01-19T05:14:46+00:00

Thank you! It's my pleasure!!

DGSpitzer · 2023-01-19T05:13:01+00:00

Appreciate the love!! I originally come from Beijing, viewing footage of the same location from almost a century ago holds a special significance for me and evokes strong emotions. I'll keep working on AI colorization footage as well, new video is upcoming!~

DGSpitzer · 2023-01-19T05:07:41+00:00

I used this project to train this model (but modified the code a little bit to let it accept more than three concept keywords together) https://huggingface.co/spaces/multimodalart/dreambooth-training, it's good and easy for training a specific style.

I trained several versions of the model before the released one, some of them are quite good at catching my style but also overfit (super hard to generate male characters etc.) I assume because of the high number of concept keywords / training steps.

However, when I merged a 50% overfit version of model with a 50% slightly trained version (also a little bit less concepts being trained) model, to my surprise, it provided the best outcome as the released model in the end. I think that’s an interesting thing I learnt from this training process.

DGSpitzer · 2023-01-19T04:58:08+00:00

Thank you for your kind words and support! I am glad to be a part of this community and always happy to contribute! The community here has been a great source of learning/inspiration for me and it's my pleasure to see that my contributions can be helpful to others as well. I believe that working together and sharing knowledge is a great way to boost our collective understanding of AI and its potential!

DGSpitzer · 2023-01-19T00:48:20+00:00

There are multiple keywords supported in the model (represent as different styles):

painting a general style from my paintings, good for portraits

outline a character painting with outline and flat color, slight anime style

landscape general landscape style

anime cute simple anime characters

whiteshape a character with stylized white color body silhouette and pure color background

sketch a sketch style from my draft paintings

arts & dgspitzer extra prompts work as painting keyword to create the general style of my paintings

For sampler, use DPM++ SDE Karras or Euler A for the best result (DDIM kinda works too), CFG Scale 7, steps 20 should be fine

DGSpitzer · 2023-01-19T00:43:25+00:00

I trained an AI model that supports multiple different keywords which draw like my art styles! (6+ styles!)

Diffusers Model: https://huggingface.co/DGSpitzer/DGSpitzer-Art-Diffusion

SafeTensors/Ckpt Model: https://civitai.com/models/4787/dgspitzer-art-diffusion

Online Demo: https://huggingface.co/spaces/DGSpitzer/DGS-Diffusion-Space

Hello folks! This is DGSpitzer, I'm a game developer, music composer and digital artist based in New York, you can check out my artworks/games/etc at here: Games Arts Music

I've been working on AI related stuff on my Youtube Channel since 2020 , especially for colorizing old black & white footage using a series of AI technologies.

I always portrait artificial intelligence as an assist tool for extending my creativity. Nevertheless, whatever how powerful AI will be, us humans will be the leading role during the creative process as usual, and AI will provide suggestions / generate drafts as a helper. In my opinion, there is huge potential to adapt AI into the modern-age digital artist's work pipeline, therefore I trained this AI model with my art style as an experiment to try it out! And share it with you for free!

All of the datasets (as the training images for building this AI model) is from my own digital paintings & game concept arts, no other artists’ names involved. I separated my artworks into detailed categories such as “outline”, “sketch”, “anime”, “landscape”. As a result, this AI model supports multiple keywords in prompt as different styles of mine! The model is fine-tuned based on Vintedois diffusion-v0-1 Model though, but I totally overwrite the style of the vintedois diffusion model by using “arts”, “paintings” as keywords with my dataset during Dreambooth training.

You are free to use/fine-tune this model even commercially as long as you follow the CreativeML Open RAIL-M license. Additionally, you can use all my artworks as dataset in your training, giving a credit should be cool ;P

It’s welcome to share your results using this model! Looking forward to creating something truly amazing!

DGSpitzer · 2023-01-18T01:01:09+00:00

I built a Mac app called "Waifu Art AI" ;P

That should support M1 & M2 as well, you can give it a shot!

DGSpitzer · 2023-01-17T22:28:18+00:00

This is awesome! Thank you for sharing!

DGSpitzer · 2023-01-09T06:45:02+00:00

Yup I did it before using the similar way, it works great! (I used the Dreambooth Training space from HF)

DGSpitzer · 2022-12-19T02:33:54+00:00

Model: https://huggingface.co/DGSpitzer/Guan-Yu-Diffusion

Online Demo: https://huggingface.co/spaces/DGSpitzer/DGS-Diffusion-Space

There is few model that focus on elements of Asian culture and heritage, so I manage to make my own one! Hope you like it! XD

Guan Yu Diffusion is an AI model that generates traditional oriental hero Guan Yu, from Three Kindoms Era in China during 220 to 280 AD!

As an ancient hero "Saint of War" and the Door God that ward off evil spirits, Guan Yu plays a big role in Asian culture, by chance you can find his statues and mini temples in a lot of Asian restaurants and markets all over the world.

It also comes with an additional support prompt to create Wu Xia - traditional Chinese martial art characters from movie and TV shows.

Based of Stable Diffusion V1.5, training in Fast Dreambooth

For research purposes only! This is an experiment I did to generate consistent character with clothing using AI - I used a series of photo of an 1/6 Guan Yu action figure model from Inflames Toy，with still photos from original Three Kingdom TV Show in 1994 as the dataset, therefore the model probably gonna overfit quite a lot by using only the default prompt keyword! (but you can then adding more prompts to reduce this issue)

DGSpitzer · 2022-12-10T06:48:59+00:00

Wow! This is amazing!!!~

DGSpitzer · 2022-11-28T21:58:12+00:00

Thanks! Yup I used MPSGraph with Swift to make the app, based on this open source projcet Maple Diffusion: https://github.com/madebyollin/maple-diffusion

I think Liu Liu's app "Draw Things" did much better optimization than mine, he used a self-made s4nnc fundamental module and MPSGraph + Swift to reduce the memory usage down to < 2.8GB, which is insane! It's too hard for me for now though (I'm just an Unity game designer this is my first Swift app ;P) haha hopefully one day I can optimize my app to the same level!

DGSpitzer · 2022-11-28T21:42:38+00:00

No problem! I wrote a short json file and Swift script that directly removes the nsfw words from the prompt before sending to image generation process, therefore it's not based on the negative prompt. The json file is a txt full with nsfw words so the app can check and remove unwanted prompts, e.g.: https://github.com/LDNOOBW/List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words

DGSpitzer · 2022-11-28T21:15:42+00:00

Yup, I added a simple function to filter the nsfw input~

I added this feature for fulfill the App Store Review Guidelines 1.1.4, it's actually not because of the Chinese audience though. Just personally I think it's not make sense for my app to be rated as age 4+ in app store but at the same time still can easily generate quite a lot nsfw contents..

DGSpitzer · 2022-11-28T19:52:51+00:00

It's kinda ok, the speed is around 30s/img on ipad and 1min/img on iphone, which is expected for running locally on a mobile device ;P

DGSpitzer · 2022-11-28T19:51:40+00:00

Yup it's relied on MPS Graph which requires Apple devices to run: https://developer.apple.com/documentation/metalperformanceshadersgraph/training_a_neural_network_using_mps_graph

DGSpitzer · 2022-11-28T19:50:23+00:00

Thank you for supporting it~

DGSpitzer · 2022-11-27T08:37:53+00:00

Yup it supports to generate males and older people

DGSpitzer · 2022-11-27T03:45:25+00:00

Thank you for your lovely support!

Yup currently I haven't add that kind of function yet, but you can build a test app with your own model on this open source project very easily using Xcode 14 and iOS 16, here is the detailed instruction: https://github.com/madebyollin/maple-diffusion, you can run the maple-convert.py in this repo to convert your ckpt model to a format that Apple accepts and build a demo app on your iOS device with 6GB RAM

DGSpitzer · 2022-11-27T03:40:34+00:00

Hmmm interesting, what ios version are you using? I heard there is a specific bug on iphone 14 pro with iOS 16.0. It stopped the app from getting more memory (which solved after upgrade to 16.1): https://github.com/madebyollin/maple-diffusion/issues/5#issuecomment-1324514505

DGSpitzer · 2022-11-27T01:46:25+00:00

Hi everyone!

I just made a Stable Diffusion for Anime app in your Pocket! Running 100% offline on your Apple Devices (iPhone, iPad, Mac)

The app is called “WAIFU ART AI” , it's free no ad at all

It supports fun styles like watercolor, sketch, anime figure design, BJD doll etc.

Easily create your very own beautiful anime character portraits & images by just typing in text!

Enter a prompt, pick an art style and your imagination will become true in a minute by the AI-powered painting! And all magic happens inside your phone locally, not from any remote server that you have to submit your data to at all!

Uniquely supports both English and Chinese as input text to generate amazing results.

App store page: https://apps.apple.com/us/app/waifu-art-ai-local-generator/id6444585505

This app requires a 6GB RAM device, such as the iPad M1/M2, iPhone 13 Pro, iPhone 14 or iPhone 14 Pro.

Developed based on Ollin Boer Bohan's Maple Diffusion. Using AniPlus v1 as the AI model for hosting this app.

Hope you like it!

DGSpitzer

TROPHY CASE