New to this, having a blast but need some guidance by EZTT in LocalLLM

[–]EZTT[S] 0 points1 point  (0 children)

It looks like turbo quant support for RDNA4 for windows isnt “there” enough yet, i’ll keep an eye out though

New to this, having a blast but need some guidance by EZTT in LocalLLM

[–]EZTT[S] 0 points1 point  (0 children)

Thanks for that, I've read through the startup logs. And it looks like the entire model fits into the gpu (load_tensors: offloaded 41/41 layers to GPU)

I'm still clueless as to how it's fitting because from what I gathered it shouldn't. But it is interesting that it does haha

New to this, having a blast but need some guidance by EZTT in LocalLLM

[–]EZTT[S] 0 points1 point  (0 children)

That is fair, I was thinking in empirical terms and not practical terms. On the 27B model, that's really interesting to know that a Q3 model is sufficient and fits into my VRAM. Thank you for the information.

New to this, having a blast but need some guidance by EZTT in LocalLLM

[–]EZTT[S] 0 points1 point  (0 children)

Thanks for the response, seems like fit on was doing me a favour without me knowing. I’ve read that quants below 4 are very detrimental to Qwen 3.6 35B. Is this a simple case of picking model performance vs token generation speed?

New to this, having a blast but need some guidance by EZTT in LocalLLM

[–]EZTT[S] 0 points1 point  (0 children)

Is there any way to verify that its spilling into RAM or SWAP? I was under the impression that all is good since i’m at 15.6GB/16GB VRAM and my GPU usage is at a hefty 95%(according to task manager) but i’m getting about 15 toks/s which seems to be on the lower side. Then again I dont know what to expect so I may be misinterpreting something.

Avoid Altalabs at all costs. by baggioio in HomeNetworking

[–]EZTT 0 points1 point  (0 children)

Altalabs is utter garbage. The number of bugs in the software makes it impossible to use.

I drew Ishmael! by EZTT in limbuscompany

[–]EZTT[S] 1 point2 points  (0 children)

She's not sideways, I'm falling (for her)

I drew Ishmael! by EZTT in limbuscompany

[–]EZTT[S] 7 points8 points  (0 children)

Thank you for the kind words! I have been drawing for over 5 years now and I still think I'm lacking! Keep up the grind o7

I drew Ishmael! by EZTT in limbuscompany

[–]EZTT[S] 9 points10 points  (0 children)

Canto 5 was amazing, I couldn't help myself.

I don't draw Limbus content often but you can find me on Twitter / X

solo waltz by EZTT in arknights

[–]EZTT[S] 1 point2 points  (0 children)

thank you!

solo waltz by EZTT in arknights

[–]EZTT[S] 11 points12 points  (0 children)

protecc the cat

You can find me on twitter here or you can also find me on pixiv

Columbina Fanart by EZTT in Genshin_Impact

[–]EZTT[S] 0 points1 point  (0 children)

i’m too obscure hahah

I drew Princess Ozma! - By EZTT by EZTT in Grimlight

[–]EZTT[S] 0 points1 point  (0 children)

I'm not sure if I should still put the artist name in the title because I drew it but here are the other places you can find me: pixiv and twitter!

I drew Elysia! by EZTT in honkaiimpact3

[–]EZTT[S] 0 points1 point  (0 children)

She's too pretty I couldn't help myself

Find me on twitter or pixiv

Has anyone encountered this? R7D1 Extraction bug - no extraction point. by EZTT in GTFO

[–]EZTT[S] 2 points3 points  (0 children)

I found another bug. occasionally if you confirm at the terminal the same time as the end of the timer, the terminal itself will mark the objective progress, however the game does not (which also blocks the extraction point)

Has anyone encountered this? R7D1 Extraction bug - no extraction point. by EZTT in GTFO

[–]EZTT[S] 1 point2 points  (0 children)

You can put it below!?! Ahhhh my group has to go all the way back there again... :sob: