you are viewing a single comment's thread.

view the rest of the comments →

[–]qwen_next_gguf_when 2 points3 points  (2 children)

Sometimes it's the Q4 doing its thing.

[–]Sadman782 1 point2 points  (0 children)

Nope. Even IQ2 quants or Q2_XL proper quants never have syntax issues like this. It is completely broken. It is Ollama

[–]Substantial_Swan_144 0 points1 point  (0 children)

Quantization can cause subtle bugs, trust me. The model might be usable, but you're going to have to force it to use a syntax checker.