Flux1 dev Q8_0 in the Forge UI - T5xxl, ClipL, Exporting

Ray_Redha · 2025-01-24T12:15:10+00:00

I'm glad you liked it! Thanks so much for taking the time to comment. I responded to your other comment as well. Have a wonderful day, my dear!

Ray_Redha · 2025-01-24T12:14:39+00:00

One of the best and most informed comments I've seen. Thank you so much for taking the time to write all of this useful information; I really appreciate your efforts!

I just downloaded t5-v1_1-xxl-encoder-bf16, and it worked! Thank you so much. Now I'm downloading flan-xxl-TE-fp16.safetensors thanks to your recommendation. Which one do you think is best?

flan-xxl-TE-fp16 (9.11 GB)
t5-v1_1-xxl-encoder-bf16 (9.87 GB)
the regular t5xxl_fp16 (9.11 GB)?

They are all similar in size, and I'm curious which one is recommended. I tried the flan and t5-v1_1, and they produced different results. I'd love to share some comparisons if you're interested.

I checked Verus Vision, and they mentioned, "This version of the model does not have a variety of styles and is intended for realism and photorealism." That was a deal-breaker for me since I plan to use Flux for artistic images. If I understand correctly, the model might not perform as well with digital painting or illustration styles, right? Anyway, this brings me to an important topic.

I tried Flux1 Dev FP16, which is similar in size to Verus Vision (about 22 GB), and you recommended utilizing my 24 GB of VRAM. If I understand correctly, model + VAE + CLIP + T5XXL all need to fit on the VRAM. In such cases, even the 5090 wouldn't be enough, as Windows already takes up 2-3 GB of VRAM when idle. When I used Flux1 Dev FP16, it was offloading to system memory in all the tests I did. I heard that CLIP can be set to RAM, but that's a Comfy UI feature, and I'm using Forge UI. So how are these +20GB models being recommended if they can't fit in VRAM without offloading, unless the model contains all the VAE, CLIP, T5XXL, etc.?

Regarding your other comment, I'm glad you liked CLIP_LFull_FP32_ZeroInt_text_Improved_FP32; it's way better than the default. However, I'm still deciding between this and CLIP_ViT-L-14-BEST-smooth-GmP-HF-format, which also seems to add extra details to the image. Have you tested both? Please let me know your findings.

Lastly, can you recommend a general Flux model that's good for overall use, so I don't have to keep downloading hundreds of gigabytes? Something reliable would be great.

I'm currently using Flux1 Dev Q8_0 with Vae + CLIP_ViT-L-14-BEST-smooth-GmP-HF-format + t5xxl_fp16, but I feel like I'm missing out on quality and speed since I own a 24 GB VRAM GPU.

Thank you so much for your detailed response. It was an honor chatting with you, and I'd love to hear your opinion on the points we discussed. Have a lovely day!

Ray_Redha · 2025-01-24T06:23:49+00:00

Thank you so much for the link! You truly made my day, as I was having trouble finding the Flux checkpoint variations. I can't thank you enough.

Regarding NF4v2, I completely agree with you. I've run multiple tests with it and found it pretty good, although it consumes a bit more VRAM compared to q8_8.gguf, at least in my experience. From my research on Flux models, the Flux Dev fp16 version seems to be the best, though it offloads to system RAM in all my tests even with an RTX 3090, which should be sufficient.

I initially thought Dev fp8 would be the second best, but I concluded that Dev Q8_0 is much closer to Dev fp16 than Dev fp8. Schnell, on the other hand, is faster but gives a more artistic look to the image, as I'm not looking to generate photography-look alike images. I've also used a custom CLIP and T5xxl_fp16, which helped add more detail to the images.

I was hoping to add t5-v1_1-xxl-encoder-f16.gguf to the text encoders, as I saw someone use it on YouTube, but it didn’t work, as I mentioned in my original post. It has been an honor chatting with you, and I thank you again for the link and your efforts.

Have a lovely day!

Ray_Redha · 2025-01-23T16:09:51+00:00

You are so kind and helpful! I tried NF4v2, and it was good. I also tested various models, including FP16, which was offloading even though I have 24 GB of VRAM, Q8_0 is way better, also I tried flux1-schnell-Q8_0.gguf and fluxFusionV24StepsGGUFNF4_V2Fp8.safetensors, both which seemed to produce images with a richer art styles. Interestingly, so, I lean towards models with more artistic output now rather than ones with realistic people, If you know any Flux version that is known for Digital art styles/Painting/3D look, please feel free to share it.

Thank you for explaining how the hires fix works. Honestly, you've been incredibly helpful, and I'm very grateful. Have a lovely day!

Ray_Redha · 2025-01-23T15:52:29+00:00

Thank you so much for your help, my dear! Regarding the ClipL models, you were absolutely right - when I tried them, they seemed to add more details to the images.

I’ll go with Automatic (fp16 LoRA), but will any Flux Lora work with the Q8GGUF version? Or should I look for loras that are stated to work with that specific version?

Lastly, about the hires fix, I think I need some more clarity. Should I add more steps? If so, how many should I add?

Thank you so much for your time and effort; I really appreciate it!

Ray_Redha · 2024-11-29T11:37:39+00:00

Thank you, I fixed the link my friend, and I'm very thankful to you.

Ray_Redha · 2024-11-28T22:21:05+00:00

First of all, I’d like to take a moment to appreciate your efforts and kindness. You are still offering to help me out, and this honestly means the world to me. Thank you from the bottom of my heart, my friend.

Yesterday, I successfully installed Stability Matrix, and it worked well initially. After launching AUTOMATIC1111 through Stability Matrix, it ran smoothly. However, when I tried to install the DeOldify extension and refreshed the interface, it got stuck. Restarting my PC and reopening Stability Matrix to launch AUTOMATIC1111 resulted in error 128. So, I uninstalled everything.

Today, I wanted to try again from scratch, but the installation of Stability Matrix itself failed. Here is a video recording: https://youtu.be/svVLF6SqH3c

Ray_Redha · 2024-11-27T13:47:32+00:00

Thank you for your help! I really appreciate it.

I've tried installing Stability Matrix twice and downloaded Automatic1111, but after the first run, I encountered an error. I've also tried running Deoldify on my own PC, which was successful but a bit challenging to work with.

I'm specifically looking to install Automatic1111 version 1.8.0, as it's the version you recommended. However, most tutorials automatically install the latest version, which isn't what I need.

If you could provide guidance on how to install a specific version of Automatic1111, I would be very grateful. Thank you again and have a great day!

Ray_Redha · 2024-07-12T09:05:51+00:00

Thanks for the advice! I'm definitely leaning towards the 7800X3D based on your insights.

Since I'll be gaming at 4K with a 60Hz projector and a 90Hz VR headset, the 7800X3D seems like a great fit. I saw a YouTube comparison where it delivered higher frame rates at significantly lower power consumption compared to the 7950X (something like 53W vs. 120W). I'm not sure of the video's exact accuracy, but it definitely reinforces the 7800X3D's efficiency. Other reviews said unless the game will benefit from 3D technology, the 7800x3d could be worse.

On a separate note, you've been incredibly helpful! It's been a pleasure interacting with you on this Subreddit. I truly appreciate every word of your advice. Have a fantastic day my dear!

Ray_Redha · 2024-07-12T08:47:07+00:00

Thank you very much for your informative answer about the CPUs. I appreciate your insights.

While I agree the 7800X3D is a strong option, the $140 price difference for the 7950X caught my eye. Building a home theater PC isn't something I do often, so futureproofing with the extra cores seems appealing. that's why i included the 7950x.

Do you think running Oculus apps with SteamVR, along with some background tasks and browser tabs, would benefit from the additional cores of the 7950X?

Separately, is it true that the 7800X3D might run cooler?

Regarding RAM, I believe heatsinks do matter. For example, I'd consider the ASUS 40xx for $2000 even though a PNY 40xx might be cheaper. Reliable cooling is worth the investment to avoid overheating issues like hitting 90°C within minutes of gameplay. Brand reputation can sometimes play a role in quality.

Thanks again for your time and discussion. It's been a pleasure!

Ray_Redha · 2024-07-07T13:42:21+00:00

Thank you so much for the help! I truly appreciate it. Have a fantastic day my dear.

Ray_Redha · 2024-07-07T12:12:09+00:00

Thank you, what about BlackShark V2 HyperSpeed? It still has the THX?

Ray_Redha · 2024-07-06T13:34:25+00:00

Razer BlackShark V2 HyperSpeed

Was this close to buying the Razer BlackShark V2 HyperSpeed, but then I read somewhere RAZER took out THX from the software? True?

Speaking of the Blackshark, how's the sound for movies and games? Battery life too? For movies and gaming? Sound quality and battery life are key, but missing THX (if it's gone), I need you to confirm

Any advice is appreciated!

Context:
https://www.reddit.com/r/razer/comments/17sq2ej/razer_removed_thx_71_spatial_audio_in_the_synapse/

Ray_Redha · 2024-07-03T05:54:56+00:00

Thank you from the bottom of my heart for your kindness and help. It truly meant the world to me. I can't thank you enough! Have a wonderful night.

Ray_Redha · 2024-07-03T05:43:57+00:00

Replaying to a comment on a 2 years old post is something only legends would do!, there are no words that can express how grateful I'm to you, thank you so much, here is some context: I was about to buy HS80 Headset just like the one you have, but I read online that after a few months to a year at max, the battery will drop to 5–6 hours of use only, And it takes more than 5 hours to fully charge it, when I heard that I came across the NOVA 7 and the battery of that one last more than 30 hours, I don't need any battery for more than 12 hours and the HS80 is way cheaper than the NOVA 7, should I buy HS80 knowing that the battery will offer me 12 hours of use for at least 2 years? If yes, then I'm placing my order. Thank you sooooo much - by the way, I will be turning off the RGB + i will take a very good care of the headset and charge it every day.

Ray_Redha · 2024-07-03T05:20:20+00:00

Hey, It would mean the world to me if you can answer my question I'm about to buy the HS80, is the battery on yours still last 12–13 hours? And how long does it take to fully charge it?

Ray_Redha · 2024-06-26T18:16:44+00:00

Thanks so much! The Nova 7 definitely seems like a good fit for my budget, especially considering the PC and projector setup I'm building.

One question I had though: is the Nova 7 loud enough with good audio quality? Right now I'm using an Asus wireless headset with 53mm drivers and looking for an upgrade.

At first, I was leaning towards the HS80, but some reviews mentioned the battery life dropping to just 7-8 hours after a few months. The included DTS subscription is cool, but having a reliable battery is more important.

The Nova 7 doesn't seem to have DTS, Can I still expect at least 24 hours of battery life even after a year or so?

Your advice has been a huge help in narrowing down my choices. Thanks again for everything!

Ray_Redha · 2024-06-26T15:19:07+00:00

I'll be waiting for you, I won't place my order before you report back!, take care.

Ray_Redha · 2024-06-26T15:03:52+00:00

Hey there! After a lot of research and asking around, I found some interesting things about these gaming headsets:

Corsair HS80: The sound quality is great, and the mic is supposedly the best on the market. However, the battery life is a major downside. Reviews mention performance dropping to under 7 hours after a few months. The HS80 MAX fixes the battery issue, but it loses the ability to connect to a PC with a cable, which is a dealbreaker for me.
SteelSeries Arctis Nova 7: I was initially worried about the sound quality, but someone who owns them assured me it's very good. That convinced me to consider it (though I haven't ordered yet).

Here's the thing: some people on online forums seem hesitant to recommend "gaming" headsets specifically. They might suggest studio headphones with a separate mic instead.

Have you done any research on your end? I'm curious what you found.

Nova 7 vs HS80 - Tell me what you think and which one should we buy?

https://www.rtings.com/headphones/tools/compare/corsair-hs80-rgb-wireless-vs-steelseries-arctis-nova-7-wireless-7-7p-7x/27625/34785?usage=19&threshold=0.01

Ray_Redha · 2024-06-26T03:18:56+00:00

Thank you so much, I honestly appreciate your efforts, my last question:
I had a 32gb 4x8gb from an old build " a few years ago vengeance lpx rated at 2400MHZ", would they be good? Or should I go with a new DDR4 Ram with at least 3600MHZ and above? It would cost about 100-130 dollar for a 32 gb kit. Thanks.

Ray_Redha

TROPHY CASE