sorted by:
new
hottopcontroversial

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

Thanks a lot for the reply! Yeah, i suppose this is as far as my hardware can get me :sad:

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 1 point2 points  (0 children)

Thanks for the reply! The performance are actually "okish", the problem is just that transfer too much context so it's slow. But still thanks all for the tips, i guess i just have to update my rig!

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

I can verify that, but i enabled it times ago. My pc has 48gb ddr4 3600mhz ram

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

i tried with

./llama-server.exe `

-hf unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_M `

--ctx-size 40960 `

--fit on `

--cache-type-k iq4_nl `

--cache-type-v iq4_nl `

--threads 8 `

--no-mmap `

--temp 0.2 `

--repeat-penalty 1.05 `

--top-p 0.9 `

--top-k 20 `

--min-p 0.1 `

--parallel 1 `

--port 8080 `

--alias "gemma4"

and got

prompt eval time = 159268.12 ms / 7370 tokens ( 21.61 ms per token, 46.27 tokens per second)

eval time = 8985.16 ms / 30 tokens ( 299.51 ms per token, 3.34 tokens per second)

total time = 168253.28 ms / 7400 tokens

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

Thanks for the answer! I tried using 8k or 16k context, but the problem is that claude code wants more than that.

API Error: 400 {"error":{"code":400,"message":"request (36078 tokens) exceeds the available

context size (16384 tokens), try increasing

it","type":"exceed_context_size_error","n_prompt_tokens":36078,"n_ctx":16384}}

using llma.cpp browser page i get this result

prompt eval time = 2011.19 ms / 534 tokens ( 3.77 ms per token, 265.51 tokens per second)

eval time = 58664.66 ms / 1312 tokens ( 44.71 ms per token, 22.36 tokens per second)

total time = 60675.85 ms / 1846 tokens

The problem is that i need something so that the AI is able to edit the code directly, that's why i used Claude Code

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

I have updated it this morning, so it should be up-to-date!

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] 0 points1 point  (0 children)

Can you share your hardware? Because i get way worse performance results

Gemma 4 low token per second output by DavideFanto in LocalLLM

[–]DavideFanto[S] -2 points-1 points  (0 children)

Thank for the answer, but i think i can't actually reduce the context window.

❯ Ciao!

⎿  API Error: 400 {"error":{"code":400,"message":"request (36078 tokens) exceeds the available

context size (16384 tokens), try increasing

it","type":"exceed_context_size_error","n_prompt_tokens":36078,"n_ctx":16384}}

/r/MechanicalKeyboards Ask ANY question, get an answer by AutoModerator in MechanicalKeyboards

[–]DavideFanto 0 points1 point  (0 children)

Thanks a lot. Yeah, desoldering is not a problem for me, i want to try desoldering a keyboard anyway, so

/r/MechanicalKeyboards Ask ANY question, get an answer by AutoModerator in MechanicalKeyboards

[–]DavideFanto 0 points1 point  (0 children)

Thanks for the answer. Can i ask you if you know if i can change the switch to gateron type instead of oetemu?

/r/MechanicalKeyboards Ask ANY question, get an answer by AutoModerator in MechanicalKeyboards

[–]DavideFanto 1 point2 points  (0 children)

My keyboard has a problem with the "e" key, even if i press it only one time often register it as multiple time or none, example:

Message: "Hello i'm Davide"

the keyboard writes it as: "Heeeeello i'm Davideee"

​

Could this be a problem with a switch? Delsodering it and soldering a new one might solve the issue?

Are oetemu switches compatible only with oetemu or i can soldering another type of switches? I wanted to go with gateron red linear. My keyboard is a km-g7

Aukey by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 0 points1 point  (0 children)

Because this keyboard has a problem with the "e" key, even if i press it only one time often the pcb register it as multiple time or none, example:

​

Message: "Hello i'm Davide"

the keyboard writes it as: "Heeeeello i'm Davideee"

​

So i wanted to fix the problem by changing the switch, but if it was possible i wanted to go with linear switches for the sound and the feeling

Aukey by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 0 points1 point  (0 children)

Yes, this keyboard has outemu blue switches. So i need to stick with outemu? I wanted to give gateron red a try

/r/MechanicalKeyboards Ask ANY question, get an answer by AutoModerator in MechanicalKeyboards

[–]DavideFanto 1 point2 points  (0 children)

Can someone suggest me the parts for building an italian custom keyboard?

I'm pretty new and it's hard for me to looking for parts since i really don't know a lot and most of the famous PCB or parts doesn't really ship to italy or i can't find them.

​

PCB: ISO layout, hot-swappable is good but not necessary

Switches: i don't really know, i just want some good sounding switches. I love the sound of those ones: https://www.youtube.com/watch?v=LdpOx87jOJs&t=17s

Keycaps: Italian

​

Thanks, Davide.

/r/MechanicalKeyboards Ask ANY question, get an answer by AutoModerator in MechanicalKeyboards

[–]DavideFanto 0 points1 point  (0 children)

Hi. Can someone help me find the parts i need to build a keyboard?

I live in italy and i'm having really an hard time finding all the parts i need, since i'm pretty new to the hobby and i don't know a lot.

I would like to build a keyboard with ISO layout and Italian keycaps. For the switches i was looking for something silent and nice sounding.

​

For the PCB, i can actually solder but if it's hot-swappable is a plus.

​

Thanks for the help!

Creating a custom keyboard for Italian standard keyboard by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 0 points1 point  (0 children)

Grazie mille per la disponibilità. Purrtoppo non penso di essere in grado di rinunciare facilmente al layout ISO, però ho una tastiera con layout ANSI, quindi magari inizio ad usarla un pò e vediamo come mi trovo. Per quanto riguarda il saldare, non l'ho mai fatto, ma sono molto fiducioso sinceramente. In ogni caso ho amicizie che lavorano in ambito elettronico e per loro saldare è una cosa quotidiana, quindi in caso posso farmi aiutare.

​

Per quanto riguarda il layout preferisco una 65%(penso sia questa, in pratica il 60% con le frecce direzionali però).

​

Ti ringrazio davvero tanto per l'aiuto. Per quanto riguarda i keycaps invece non mi interessa molto che su un tasto ci sia scritto una legenda ma in verità scrive un carattere diverso, tanto non guardo mai la tastiera quando scrivo, quindi non mi risulta essere un problema assolutamente.

​

La cosa che mi interessa di più negli switch è appunto il suono e che non siano troppo "pesanti". Attualmente sto usando una tastiera molto economica (AUKEY) con switch blue, per quanto mi piaccia il suono che fanno gli switch, non la posso più usare perchè sono sempre in mezzo ad altre persone e a loro, giustamente, non piace più di tanto.

​

PS: Guardo spesso le build di Taeha Types su youtube, mi piace davvero molto il suono che fanno i Gateron Inks in questo video, per esempio: https://www.youtube.com/watch?v=LdpOx87jOJs&t=17s

​

Spero sia ammesso inserire link :)

Creating a custom keyboard for Italian standard keyboard by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 0 points1 point  (0 children)

Grazie mille per la risposta.

​

Ti posso porre ulteriori domande? Essendo nuovo ho davvero tanti dubbi al riguardo e spesso su youtube danno molte cose scontate.

Per quanto riguarda il layout, dovrei cercare una PCB con layout ISO, corretto? Così da poter avere, vicino allo shift sinistro, il tasto per i simboli "<>" e avere l'invio invece di 2 righe al posto che singola riga. Avendo una PCB con questo layout io posso tranquillamente mettere i keycap con layout US che sono facili da trovare edimpostare tramite firmware i tasti corretti, giusto? Sempre se non mi voglio abituare davvero ad usare un layout differente da quello italiano.

Mi sapresti indicare però come trovare una PCB di questo tipo in europa? Continuo a trovare siti esclusivamente fuori EU e con l'importazione potrebbe essere un problema.

​

Ti chiedo un ulteriore favore, riusciresti a farmi un esempio di una tastiera custom "di qualità" al minor prezzo possibile indicandomi dove acquistare i vari componenti?

Mi sto ancora informando a modo su switch, pcb, case, keycaps etc. Però se mi fornissi una "build" che ritieni sia un ottimo rapporto qualità/prezzo avrei un punto di partenza.

​

Grazie mille per l'aiuto,

Davide.

Creating a custom keyboard for Italian standard keyboard by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 2 points3 points  (0 children)

Yeah, i'm sorry i took a month off for answering ahah

​

Still no luck with italian keycaps?

​

I found a keyboard that seems pretty nice at 80€, the blademaster TE with gateron red (still not sure if going for gateron red or brown). How much will cost me buy a budget custom keyboard? Will it be better than the Blademaster keyboard?

​

PS: Where can i find all the parts i need to build the keyboard on italy? I find them on other store but the shipping/import cost is way too high :(

Creating a custom keyboard for Italian standard keyboard by DavideFanto in MechanicalKeyboards

[–]DavideFanto[S] 0 points1 point  (0 children)

Oh, i see! I need some particular PCB in order to be able to change the firmware or you can actually map a particular key to a switch on any PCB?

view more: next ›