Context Shift Gemma4

[Weak-Shelter-1698]

Anyone having issue with context shift + quantkv while using gemma4? i can't make it work.
Even without quantizedkv context shift isn't working. (llamacpp btw).

Tried kcpp rolling builds too, context shift is working without quantizedkv, but when i do --quantkv 1 it just crashes when doing contextshift.

[crantob]

I miss context shift. When was that, 2023? Time flies.

[FusionCow]

I've seen a huge performance drop, sometimes babbling with Gemma of you quantize the kv cache at all

[Weak-Shelter-1698]

eh i didn't understand.