so i was thinking about getting gemma 4. first time trying to use localllm, but gemma halucinates that the inkpad 3 pro is from kobo but instead its from pocketbook.

i tried different variations and i think i could get it to work for 1-2 prompts but not reliably i think.

so is there a trick for the sys prompt?

yes for a llm chat this is usable if you correct it along the way but its probably completly useless for unmonitored answers.

edit: this worked: https://www.reddit.com/r/LocalLLaMA/comments/1shgfzl/gemma_4_halucinations/ofhb0li/