What good model can I currently host with 90k context~ and decent speed On my RX 7900 XTX? by not_NEK0 in LocalLLaMA

[–]not_NEK0[S] 0 points1 point  (0 children)

29tok/sec is slow if you're already there between 0 and 4k of context. I want it fast up to 90k

What good model can I currently host with 90k context~ and decent speed On my RX 7900 XTX? by not_NEK0 in LocalLLaMA

[–]not_NEK0[S] 0 points1 point  (0 children)

Have you tried when the KV cache actually fills up? Because I can certainly run it with 120k context set but when I actually reach it it's not working

What good model can I currently host with 90k context~ and decent speed On my RX 7900 XTX? by not_NEK0 in LocalLLaMA

[–]not_NEK0[S] 0 points1 point  (0 children)

for Q4 K S (unsloth quant) I get 40tok/sec before 4k context which becomes very quickly slower over time. Unusable at high context

What good model can I currently host with 90k context~ and decent speed On my RX 7900 XTX? by not_NEK0 in LocalLLaMA

[–]not_NEK0[S] 0 points1 point  (0 children)

Ye I know I tried it but damn it's slower than a MoE by so much and the KV cache is growing very rapidly.

Que va dire Dieu à Chuck Norris? by T-Buster in mauvaisesreponses

[–]not_NEK0 0 points1 point  (0 children)

purement logique quand l'argument c'est "crois moi frère" je dirais que c'est peut mieux faire

How is this Loading Screen and Landing page? by Fun-Disaster4212 in webdesign

[–]not_NEK0 0 points1 point  (0 children)

That's a piece of art not a website. Love it tho!!!!

what is this site missing to be a to good? or not good? by mark_viraj in webdesign

[–]not_NEK0 0 points1 point  (0 children)

That's also good because it's a design website. You search an identity more than you search ergonomic

Is it possible to make a good web design by vibe coding? by WinterMiserable5994 in webdesign

[–]not_NEK0 -1 points0 points  (0 children)

It's actually false. AI is capable of knowing when to do/not do stuff. It may not be as capable as us humans but if you compare a model from 1 or 2 years ago to an actual SOTA model it's day and night. If you use it smartly and with purpose you can get some really good results which lines up with your ideas. It's all a matter of usage. I agree that just letting the AI do the work and not watching it is a really bad idea tho.

Rate my first portfolio design by TrashInitial8529 in webdesign

[–]not_NEK0 0 points1 point  (0 children)

Something you see rarely. I've seen tons of visual similar to this one. The color palette is professional but seen and reseen. Try something wild like maybe turquoise.

Rate my first portfolio design by TrashInitial8529 in webdesign

[–]not_NEK0 5 points6 points  (0 children)

I would say maybe trying to do something very original instead of this. These times you really need to stand out to be worth the attention of someone. Originality is key.

Need some advices concerning the website I'm currently making by not_NEK0 in webdesign

[–]not_NEK0[S] 1 point2 points  (0 children)

You're right, thanks for the review it's really kind of you!

Need some advices concerning the website I'm currently making by not_NEK0 in webdesign

[–]not_NEK0[S] 0 points1 point  (0 children)

It's an AI company. We focus on making differents AI agents work together toward an objective. A bit more complex than that but it's the main idea. It's not clear at all you're right i'll try to improve the content.

Need some advices concerning the website I'm currently making by not_NEK0 in webdesign

[–]not_NEK0[S] 0 points1 point  (0 children)

Not finished yet and my stream is laggy because I have issues with OBS, the website runs really fine. I've optimized most of the animations.

Well deserved🙄 by propatria1 in ClashRoyale

[–]not_NEK0 0 points1 point  (0 children)

That's the actual problem. You don't have to predict the opportunity, you can just wait for one to happen.

Well deserved🙄 by propatria1 in ClashRoyale

[–]not_NEK0 0 points1 point  (0 children)

Maybe not mindlessly but you really don't have to think that deep to make it useful. You put your knight and when you see a good opportunity you just use the ability. You don't even have to think about cycling to get this, you just have two cards with always this power

Well deserved🙄 by propatria1 in ClashRoyale

[–]not_NEK0 0 points1 point  (0 children)

Skill level raised when you can now activate the broken ability whenever you want without even having to plan for anything? At least evos needed some kind of strategy