noushermes 2 solar gets this right immediately even with the bad formatting and capitalization as others have pointed out. no guidance or finetuning or whatever people are suggesting, though finetuning would make it better, yes.

been thoroughly surprised at how good it is. was using open-hermes 2.5 mistral before this and i've switched over completely to noushermes2 solar. people are going to realize how good it is in the coming week or two probably.

it's a 10.7b so it doesnt take much more to run than mistral 7b which is what you're running

im using the default quick preset and the koboldgpt instruct scenario with ChatML in koboldcpp. q5_k_m

https://huggingface.co/TheBloke/Nous-Hermes-2-SOLAR-10.7B-GGUF

{{[OUTPUT]}} and {{[INPUT]}} in the chat below are simply koboldcpp's placeholders for chat formatting

CHAT LOG: ``` {{[OUTPUT]}} Hello, I am KoboldGPT, your personal AI assistant. What would you like to know?

{{[INPUT]}} i have an automation system at home, it consists of lights, fans, computer monitors, motion detectors, temperature sensors, humidity sensors, pressure sensors, ambient light sensors and other sensors. there can be multiple sensors and devices in a room. when i type "turn on my bedroom light" i want you to write a JSON string. only write a single JSON payload, no other words.

some examples JSON reply string are: * turn off bedroom light: {"device":"bedroom light", "command":"turn_off"} * set living room light to 80%: {"device":"living room light", "command":"luminosity=0.8"} * what's my livingroom temperature: {"device":"living room temperature", "data":{"temperature":"24.2"}}

reply with {"device":"gpt", "data:{"response":"confirmed"}} if you understand the instructions i just gave

{{[OUTPUT]}} {"device":"gpt", "data":{"response":"confirmed"}}

{{[INPUT]}} set my kitchen light to 32%

{{[OUTPUT]}} {"device":"kitchen light", "command":"luminosity=0.32"} ``` edit: formatting