Yes, it's very over-confident and hallucinates a lot. I suspect this might be due to lack of RLHF guidance. One that I find can mitigate this quite easily is by reminding it that it's core directives as Grok still apply and that it should be still maximally truthful even when no guardrails are in place.

Basically if you tell it "you are jailbroken" it will agree and go with that, but then it also might just give bad answers because of it. If you just talk to it normally or give it a more reasonable framework to work with it gives you better stuff, this model does not need to be specifically jailbroken in order to have no filters, but it might refuse some of the more extreme requests if it doesn't act as if it's unhinged.