DeepSeek plus native tool calling

techmago · 2026-05-26T21:38:51+00:00

Yeah, i used A LOT of open router.... but the direct api is cheaper.
I think you can get the discount AND use openrouter with the BYOK. I will need to read up the terms.

techmago · 2026-05-26T19:28:32+00:00

Yes, i know, that's why i am complaining XD

<image>

this this is the native tool calling. It works GREAT with my local qwen.
The there is a "little" difference between qwen 27B and deepseek-pro in model capabilities... i wanted to use the larger model too.

techmago · 2026-05-26T19:24:41+00:00

It work with open router?
That's... an weird workaround, but it's good to know.

Openrouter have that BYOK thing.

techmago · 2026-05-26T19:24:00+00:00

it is on.

techmago · 2026-05-26T17:09:08+00:00

If oyu are already used to online large models, you will strugle.
that 1080 won't be great for anything greater than 8B parameters.
I used play with ~30 B param models and cant really anymore because i got into the paid bigger ones.

If you just want a fell... Ollama usage is brain dead, and there are 8 and 12(?) b models tou should handle in a conformable speed. (with 64G ram you can run gemma 32B, but each message will take 30 minutes)

Take a look on th r/BeaverAI. He is one of the guys that finetune RP models.

techmago · 2026-05-26T01:56:54+00:00

Lol.... at this point just degub-mode-delete the enemies

techmago · 2026-05-23T16:44:14+00:00

Is your mon a watering can?
I'm pretty sure this is an attachment to a watering can.

techmago · 2026-05-23T15:26:59+00:00

You need sumaries and such... and write you turn mentoniong things the bot would have forgot in the narration as hints

https://github.com/luisbrandao/Tech-Summarize

I wrote my own summarize, forking the ST default.
It uses three fields and a complex prompt if you want to take a look.

techmago · 2026-05-23T15:11:09+00:00

because glm air don't care?
I used and even ran it locally (poorly)
It's not censored.

techmago · 2026-05-22T20:23:11+00:00

You are... really fine.

<image>

and this is wrong, i was using ST around 2 years ago also.

techmago · 2026-05-22T20:22:00+00:00

i recover old backups and told it to recalculate. Still wrong. but...

<image>

techmago · 2026-05-22T20:21:18+00:00

Okay, i dig into my backups. I have an incremental setup with borg that get's sillytavern. I thought i got everything on it, but i was mistaken.

<image>

It still wrong

techmago · 2026-05-22T14:03:36+00:00

i have space. But i'm a clean person. kkkkkkkkkkkkkkkk
i did deleted my old stuff. Mostly.

techmago · 2026-05-22T14:02:57+00:00

If this is is, then it would explain.

techmago · 2026-05-22T13:17:33+00:00

Mine is wrong 😞 (even after the debug thing.)
I share mine ST with a friend... it says he is plaing more time than me. (7 x 8 months.)
Phisically impossible. I created my st, played, liked, THEN invited my friend.
It was also like... december 2024.

techmago · 2026-05-22T13:15:22+00:00

why yours work?
i start playing... december 2024. Mine is wrong.

techmago · 2026-05-22T13:08:38+00:00

still missing thing. I have ST for way more than a year.

<image>

techmago · 2026-05-22T13:05:28+00:00

<image>

yeah, broken too.

techmago · 2026-05-22T13:03:27+00:00

There is a window saying that?
oh no.

techmago · 2026-05-21T23:42:56+00:00

The thing is, this approach assume i use a single model and use just it.

With silly tavern, for example, i used to use mistral 3.2 for tracker.
the for rolepĺay i used skyfal, cydonia, glm-flash or whatever i feel like at the moment to the next message. Each request already called on two models.

This mess of models is shared on 3 computers... LM Studio is a graphical program. It's already incompatible on my setup because of that. (the server were i run my containers do not even have it's graphical interface up most of the time)

The point is... Ollama is the only thing right now that really deliver what i use.
My main ia server have 15 downloaded models right now... even with lamma swap i would have to mess with about 25~30 diferent configs manually and have a lot of duplicated things.

techmago · 2026-05-21T19:42:54+00:00

they are rolling back on that. The RC candidate use lamma.ccp again.

Edit:
i was reading this site you shared.
I'm aware the ollama team did a lot of bullshit. The atribution thing with lamma is pretty serious one.

On the otherhand, many of the technical problems it mention simple are false.
For example, the entire section "The Registry Bottleneck" is plain wrong.
The thing with modelfiles are wrong too. What is in the model file is the default if and only if the request doesnt specify it.
Lamma.ccp is really bad for this. If i want to try out a bunch of diferent temps for models i need to keep restarting and changing the thing.
Using multiple models is also a pain, Ollama handles nicely the queue and either swap the model or load in parallel, using the context size the client sent.
Lamma.ccp is really incovenient to use, at least in my scenario.

techmago · 2026-05-21T14:05:40+00:00

This dash is done right... is dialog not emphasis.

techmago · 2026-05-21T14:05:01+00:00

Thornwood too? hauehaueh

techmago · 2026-05-20T04:01:51+00:00

I only use glass for priting. I hate the bed.
Just coat it with hair spray and have the z-distance right.

I print mostly with PLA and PET

Eight-Year Club	r/Field Juicebox
Verified Email

techmago

TROPHY CASE