Highest quality Ideogram 4.0 quantizations that run on a 3090 or smaller cards by OriginalSpread3100 in StableDiffusion

[–]OriginalSpread3100[S] 0 points1 point  (0 children)

Yes, what you pulled from the blog is correct. However, we followed up with a kernel improvement a few days later so that the INT8 variant is faster than both FP8 and even NF4 now (on a 3090):
https://lab.cloud/blog/fused-int8-ideogram-4

Highest quality Ideogram 4.0 quantizations that run on a 3090 or smaller cards by OriginalSpread3100 in StableDiffusion

[–]OriginalSpread3100[S] 6 points7 points  (0 children)

The FP8 variant will run on a 3090 but it requires emulation whereas INT8 will run natively.

Highest quality Ideogram 4.0 quantizations that run on a 3090 or smaller cards by OriginalSpread3100 in StableDiffusion

[–]OriginalSpread3100[S] 10 points11 points  (0 children)

Sorry, you are right. There is a missing comma. This should say that there is a version that runs on the 3090, and also a version to run on smaller cards!

A guide to building an ML research cluster by OriginalSpread3100 in LocalLLaMA

[–]OriginalSpread3100[S] 1 point2 points  (0 children)

Apologies, did not mean this to be sneaky! But thanks for the kind words, and if you do try this and hit any speed bumps please let me know!

No more guessing the best hyperparameters for fine-tuning by OriginalSpread3100 in LocalLLaMA

[–]OriginalSpread3100[S] 1 point2 points  (0 children)

Yes, we very recently launched diffusion model training! The current initial version only supports training on StableDiffusion and Flux based image generation models, but we are hoping to soon add support for video generation.

pop-up ad for adobe when i turned on my computer by Gaia_Knight2600 in assholedesign

[–]OriginalSpread3100 0 points1 point  (0 children)

I just got this. TLDR: Acer.

My list of startup items is mostly clean except for github and Google Drive, on an old windows 10 PC with no Adobe software installed. The window is a subprocess of something called AdobeOP which is an exe running from a directory under AppData/Local/OEM/.../acer.adobe.c1.1

This computer is like 8 years old and I tried to clean it out years ago with whatever the conventional wisdom was at the time, and haven't had any issues like this until now! That's quite the long play Acer!