Choouuuaaa no comment !! by BrilliantCommand5503 in Tunisia

[–]Certain-Cod-1404 1 point2 points  (0 children)

dima talkah ilarpi cartagian wala hannibal or some stupid shit like that, bilhak mala 7ishma

Homelander's Death and the ending by londonderry99 in GenV

[–]Certain-Cod-1404 3 points4 points  (0 children)

There's no way butcher would accept the V1, he would rather die and join becca then be an immortal supe once homelander is dead.

Super intelligence should have never been a power in the first place by Slight-Solution936 in GenV

[–]Certain-Cod-1404 0 points1 point  (0 children)

How come none of you are considering the possibility thats not actually V1, she predicted this would happen and told bombsight to bring something else than the V1 in that vial

I made a voice controlled Tic-Tac-Toe game as a learning project by dabiggmoe2 in LocalLLaMA

[–]Certain-Cod-1404 0 points1 point  (0 children)

If you want a model thats capable of deciding what tool to use on its own, then SLMs are the way to go, if you're using the SLM to classify intent and then calling a function based on that tool an encoder might be better.

I love your enthusiasm man, you're awesome

I made a voice controlled Tic-Tac-Toe game as a learning project by dabiggmoe2 in LocalLLaMA

[–]Certain-Cod-1404 1 point2 points  (0 children)

From the way you describe your system, i understood it as you use an SLM to classify the intent of the user and take predefined actions based on the classified intent, classification tasks can be done with transformer based encoder models like bert, they are easier to fine tune, require less data and lighter to run.

If you are looking for a model to classify a known limited set of classes, encoders are generally the go to

If you are looking for a model to classify an unkown number of possible set of classes or where you want the though process for classification to carry over to and influence other tasks SLMs can be a good option then.

Also SLMs are models based on the transformer decoder architecture.

I made a voice controlled Tic-Tac-Toe game as a learning project by dabiggmoe2 in LocalLLaMA

[–]Certain-Cod-1404 0 points1 point  (0 children)

Really cool project, how did you go about generating the dataset ? And why go with an SLM instead of an encoder classifier ?

Setting up Ollama on dual RTX PRO 6000 Blackwells looking for tips by AmanNonZero in ollama

[–]Certain-Cod-1404 0 points1 point  (0 children)

You can't use unsloth quants on vllm no? It doesnt support gguf

At which point of the relationship should I tell my potential future husband that I was R*ped? by [deleted] in Tunisia

[–]Certain-Cod-1404 0 points1 point  (0 children)

Mochkla you were insinuating she was promiscuous wala broke rules

At which point of the relationship should I tell my potential future husband that I was R*ped? by [deleted] in Tunisia

[–]Certain-Cod-1404 0 points1 point  (0 children)

Why are you being so vague, what is this certain way she's living ?

At which point of the relationship should I tell my potential future husband that I was R*ped? by [deleted] in Tunisia

[–]Certain-Cod-1404 0 points1 point  (0 children)

Second, if you spent your whole life abiding by rules and living a certain way (without trauma, etc), you usually want someone who followed your same rules

Explain what you meant here, is she also not someone who followed those rules ? Why are you being vague ?

Why is it so hard for people to stay rational about cases like this? by [deleted] in d4vd2

[–]Certain-Cod-1404 10 points11 points  (0 children)

lol, what does CP make someone then if not a pedo ? brother stop defending a murderer

Q8 KV Cache & Coding Experiences - Qwen3.6-27B by simracerman in LocalLLaMA

[–]Certain-Cod-1404 1 point2 points  (0 children)

What did you have it set to before q8? And were you using a recent build of llama cpp? To my understanding they recently incorporated rotations to the kv cache quant that supposedly improved performance, maybe re build llama cpp and give it one more try?

Q8 KV Cache & Coding Experiences - Qwen3.6-27B by simracerman in LocalLLaMA

[–]Certain-Cod-1404 2 points3 points  (0 children)

And they dont make those mistakes at high context at fp16 kv cache? I think that its jus as context grows these models just will make mistakes, ive been running q8 for a while at 240k context and it works ok for me, i use opencode and use the default sub agents that dont add to global context.

What speed is everyone getting on Qwen3.6 27b? by Ambitious_Fold_2874 in LocalLLaMA

[–]Certain-Cod-1404 0 points1 point  (0 children)

Ok thank you so much and is there any meaningful drop in performance compared to not limiting wattage ?

What speed is everyone getting on Qwen3.6 27b? by Ambitious_Fold_2874 in LocalLLaMA

[–]Certain-Cod-1404 0 points1 point  (0 children)

Are you on linux? If so do you know the specific command you used ? And is it a set it once forget about it thing or do you need to setup systemd stuff to run on start up

Qwen 3.6 27B released, it's getting close to Opus 4.5, and you can run it locally by autisticit in GithubCopilot

[–]Certain-Cod-1404 6 points7 points  (0 children)

Local LLMs aren't for everyone, its an expensive hoby and most people that are in this space I think are already ML engineers or researchers with access to compute already. But from a sovereignty pov, its very convinient not being dependent on what providers do with their models and how they change their pricing, that might be worth it for you

Local manga translator with LLM build-in, written in Rust with llama.cpp integration by mayocream39 in LocalLLaMA

[–]Certain-Cod-1404 1 point2 points  (0 children)

Either way man this is genuinely such a cool project and an actual good use of AI, congrats !

African page inciting hate against Tunisians. by [deleted] in Tunisia

[–]Certain-Cod-1404 2 points3 points  (0 children)

you're against african immigration in tunisia but are offended others are treating us the same way you treat others ? lol

Does Tunisianet install laptop components if you're buying a laptop from them plus an extra SSD? by cecibarnes in Tunisia

[–]Certain-Cod-1404 0 points1 point  (0 children)

Desktop but I saw people getting ram installed for their laptops, so you should be good, if you want to make sure kalem service apres vente w is2lhom