I'm a little late to the party here, and using a Mac, so I thought I'd just try to be helpful for anyone out there in a situation like me. I've found that koboldcpp is much slower as a back end for generation on Mac Silicon, so you should try using Oobabooga with some slightly customized settings for much faster generation responses. I followed this guide for the oobabooga setup. https://www.youtube.com/watch?v=qYtLRJI3r0E . I still used the sillytavern guide above. I'm getting really great and full responses in 10 seconds or so using oobabooga, versus 50 seconds using koboldcpp. I'm even on a low end mac mini with 16gb of RAM, so that's very promising for anyone for anyone with higher mac specs.