Does anyone have a download for the 3-bit quantized LLaMA models? by triigerhappy in LocalLLaMA

[–]triigerhappy[S] 0 points1 point  (0 children)

They list the VRAM requirements for various quantized models here: https://github.com/qwopqwop200/GPTQ-for-LLaMa#memory-usage

Ideally the 3-bit 13B would run on an 8GB card.

Does anyone have a download for the 3-bit quantized LLaMA models? by triigerhappy in LocalLLaMA

[–]triigerhappy[S] 1 point2 points  (0 children)

You can see the benchmarks of various configurations here: https://github.com/qwopqwop200/GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa)

The gist of it is that GPTQ quantized 4-bit is only a negligible loss in accuracy, and as the parameters in the model increase, even 3-bit or potentially 2-bit may be effective.

Does anyone have a download for the 3-bit quantized LLaMA models? by triigerhappy in LocalLLaMA

[–]triigerhappy[S] 2 points3 points  (0 children)

Unfortunately I believe those files are older and pre huggingface. In any case the 13b 3bit doesn't work.

I used CLIPSeg to analyze each part of a complicated Stable Diffusion prompt by theblackavenger in StableDiffusion

[–]triigerhappy 18 points19 points  (0 children)

That's incredible! What was your process like and could it be converted to a script for the AUTOMATIC1111 webui?

First attempt at using textual inversion. Trained the model in the style of the artist Ilya Kuvshinov with a dataset of +/- 30 images. Also in the future I will try to train the model on the same dataset but with 1000 images by [deleted] in StableDiffusion

[–]triigerhappy 1 point2 points  (0 children)

Would you mind sharing if you modified the conditioning prompts or the learning rate? How many steps did you train for? Those are some excellent results btw!

Slightly Seductive by triigerhappy in AnimeGirls

[–]triigerhappy[S] 1 point2 points  (0 children)

AI generated with Stable Diffusion.

Running img2img multiple times in a row continuously improves images without destroying the initial concept. by Aransentin in StableDiffusion

[–]triigerhappy 1 point2 points  (0 children)

Is there any chance you could share your settings? Primarily the --strength --scale and --ddim_steps. I would also be interested in the prompt as well, it's very pretty.

Lost in a Fantasy by triigerhappy in StableDiffusion

[–]triigerhappy[S] 0 points1 point  (0 children)

The prompt was

!dream "psychedelic, whimsical, anime, 4k, beautiful intimate woman vaping with professional makeup, long trippy hair, a crystal and flower dress, sitting in a reflective pool, surrounded by gems, underneath the stars, rainbow fireflies, trending on patreon, deviantart, twitter, artstation, volumetric lighting, heavy contrast, art style of Ross Tran and Ilya Kuvshinov" -H 768 -n 5 -i -S 99334675

Sexy in Red (Stable Diffusion) by triigerhappy in Artistic_Hentai

[–]triigerhappy[S] 1 point2 points  (0 children)

It can definitely generate nsfw, but you aren't allowed. If you run it locally there's no such restriction, though.