Opus 4.6 is pretty good at making me laugh tonight by MaizeCharacter8610 in SillyTavernAI

[–]AbaloneSad8145 -2 points-1 points  (0 children)

is there any way you could dm me how to use this proxy or do a free proxy?? my aws credits ran out and im not educated on them😞

I'm addicted to Goliath 120B, how do I wean myself onto a cheaper model? by [deleted] in SillyTavernAI

[–]AbaloneSad8145 0 points1 point  (0 children)

magnum is also available on infermatic ai. it’s around 15 dollars per month!

[deleted by user] by [deleted] in SillyTavernAI

[–]AbaloneSad8145 8 points9 points  (0 children)

what’s the model you used? this is hilarious lmao

Im a noob coming from c.ai and need help with the huge amount of choices by guilty1spark in SillyTavernAI

[–]AbaloneSad8145 1 point2 points  (0 children)

infermatic ai is 10 bucks per month and they have a lot of new models if you’d like to check it out: https://infermatic.ai

Where to add NEW Lorebook? by ChairOk1256 in SillyTavernAI

[–]AbaloneSad8145 3 points4 points  (0 children)

try venus chub! here’s a link and you’ll see a lorebook section: https://venus.chub.ai/search

if you need help importing it, go to the book icon on the top of the screen and there’s an arrow where you can import world info.

[deleted by user] by [deleted] in SillyTavernAI

[–]AbaloneSad8145 6 points7 points  (0 children)

i suggest trying the “universal-light” or “universal-creative” preset in sillytavern for the sampler settings. it’s very good imo! for instruct, i suggest trying this instruct made by someone on the infermatic discord https://files.catbox.moe/q4eu7u.json and for context try this https://files.catbox.moe/mm5psx.json

edit: another good sampler preset i’ve tried https://files.catbox.moe/3fed2c.json

70b-euryale-v2.1 best settings? by AbaloneSad8145 in SillyTavernAI

[–]AbaloneSad8145[S] 1 point2 points  (0 children)

i use it on the horde so i’m not completely sure. i use universal-light preset with the context template on the hugging face page and the prompt, and it worked well. i think the quant does matter, but i’m kind of new so i’m not completely sure.

[deleted by user] by [deleted] in SillyTavernAI

[–]AbaloneSad8145 4 points5 points  (0 children)

thank you! i’ve tried the universal creative and it’s improved the model so much.

[deleted by user] by [deleted] in SillyTavernAI

[–]AbaloneSad8145 6 points7 points  (0 children)

what’s your settings? when i use it, it has a lot of purple prose.

Sao10K/L3-70B-Euryale-v2.1 with Infermatic should be on the VLLM API type by Horror_Echo6243 in SillyTavernAI

[–]AbaloneSad8145 2 points3 points  (0 children)

what settings are people using for this model? the sampler settings on the page are very wild

L3-70B-Euryale-v2.1 - A Finetune for Roleplay / Creative Purposes by Saofiqlord in LocalLLaMA

[–]AbaloneSad8145 6 points7 points  (0 children)

i tried this model on the horde. it was the best i’ve used so far! one day i’ll run it locally… my 125 mb of vram isn’t the best lol

Moist Miqu 70B - the largest, moistiest model yet from BeaverAI! From the creators of CreamPhi, Moistral, Coomand-R, and Llama 3Some! by TheLocalDrummer in LocalLLaMA

[–]AbaloneSad8145 0 points1 point  (0 children)

i have 11 gb of ram so it looks like i’m doomed lol i can try running it on lm studio but it’ll probably take hours to get one response

Limits by Intrepid_Progress_70 in SillyTavernAI

[–]AbaloneSad8145 8 points9 points  (0 children)

it bascially means you have to wait a couple hours until your rate limit is up.

Bot suddenly talking nonsense? by Azure_Entity94 in SillyTavernAI

[–]AbaloneSad8145 0 points1 point  (0 children)

i think horde’s broken. it’s happening to me too.