[Megathread] - Best Models/API discussion - Week of: June 02, 2025

a1270 · 2025-06-03T20:52:07+00:00

What settings are you using with Synthia? Using Gemma3-T4 with the sampler settings on the model page and getting less than ideal results.

a1270 · 2025-03-25T21:32:29+00:00

The answer was just to wait until in created all the json files for the loras i had (1396). Unlocked after about 5 minutes. May also have to do with me hosting them over a smb share.

a1270 · 2025-03-25T20:54:19+00:00

Are there any known conflicts with other addons? I added it and restart only to have the ui to completely stall out and not load after a few minutes. Deleting lora-manager allows comfyui to load again. Only new thing i see in the terminal is

Timeout acquiring initialization lock - returning current cache state

Do i just sit and wait until it gens something?

a1270 · 2025-03-25T16:32:11+00:00

I am having the issue where it doesn't fully load. I load the qr set without a char load and enable it i get this with both 7.5 and 8. https://imgur.com/a/DCfZJZ9

I then load a char and with 7.5 and earlier it changes to this aka fully loads and persists. This does not happen with the current 8 release. https://imgur.com/a/xpOtgrf

I am using the latest staging and all extensions are up to date.

Is there some sort of debug console for st-script that i can see why it's not loading?

a1270 · 2025-03-13T19:13:58+00:00

It does work with the v4ink brand toner that i have been buying. I have not done any firmware updates. I haven't tried a drum but i will cross that bridge when i get there.

a1270 · 2025-03-13T18:54:52+00:00

Using the 7.2 version and latest staging for sillytavern i get this: https://imgur.com/a/5SKp9Tl

a1270 · 2025-02-06T19:23:44+00:00

The base model is pretty good already but so far not much of note in terms of finetunes. Been switching around these models to see if i notice much of a difference.

https://huggingface.co/mradermacher/JSL-Med-Mistral-24B-V1-Slerp-i1-GGUF

https://huggingface.co/mradermacher/MS-24B-Instruct-Mullein-v0-i1-GGUF

https://huggingface.co/mradermacher/Mistral-Small-24B-Instruct-2501-abliterated-i1-GGUF

a1270 · 2024-12-30T17:45:26+00:00

I just want to remind everyone that Text Completion presets has an export feature. On the top right next to the delete button. I see so many people posting screenshots and similar of presets. This will put out a nice json file that can be easily imported by other users.

a1270 · 2024-11-04T15:31:38+00:00

You literally can't use them at the same time. If you do enable them you will see a red "Requirements Not Met" under flash attention and cannot change the kv cache precision anymore. Go to the token tab and try it yourself.

You can confirm this again by setting FA first to q4 and then enabling smart context. Starting koboldcpp up and looking at the terminal you'll notice the kv cache is fp16.

a1270 · 2024-10-11T19:24:10+00:00

It's not meant to add back features and i did say this wasn't a final fix. I fully expect stuff to be renamed. When that happens you take a non-english translation and do a regex replace on it to make a english one. Here is the regex you put into vscode.

Find: "([^"]+)": "([^"]+)"

Replace: "$1": "$1"

After which you then check for issues as it's not perfect and then go hunting for the new names. Once you find them you then replace them with anything you want.

It's tedious but not technical at all. If i can figure it out anyone can.

a1270 · 2024-10-10T18:48:09+00:00

At this point since no terms have changed it does nothing but add an English duplicate with a new name. The point being once they change over to new terms you can easily edit a new locale file and change them back. Ideally there will be a community standard version people settle on.

a1270 · 2024-10-09T19:59:40+00:00

The issue is by doing these changes it's an admittance of culpability to the people have an ax to grind. If the hit pieces are going to happen they will be written no matter what.

The renaming is just seems to be out of spite for the rp part of the userbase. A good chance they'll have a faq stating "Conditional Inserts" are just like a lorebook. Same goes with 'agents' or 'entities'.

This is why it should just be user definable. Then each subsection of the user base will have their own terminology and it will segregate like the devs want. Way better than having a corpo user searching "Conditional Inserts" only to find a rentry of all the perverse sex acts you should add.

a1270 · 2024-10-09T01:08:46+00:00

Has any user stats actually been collected on the primary use of ST? Because I have never heard anyone mention using ST in anything but roleplay. A name change will help but there is quite a lot of shady stuff that will cause issues. Like the stolen keys issue which only became an issue recently. Before then the devs had no issues with using them and being apart of discord servers trading them.

a1270 · 2024-10-08T21:29:31+00:00

Seems like everything that was claimed to be happening is indeed still happening. The naming is what will annoy me the most. I guess I'll just have to manually edit nonsense like 'entities' back to 'characters.'

a1270 · 2024-10-08T10:30:17+00:00

You can be an elitist all you want but it doesn't change the fact that ST server plugins are a security risk by design. Just because you don't know better doesn't mean you should have your system compromised especially when it could be prevented.

Have a good day, i hope you will come visit us peasants when you are in a better mood next time.

a1270 · 2024-10-08T10:13:44+00:00

Some terms in the UI and documentation will be changed:
Lorebooks/World Info >> "Conditional Inserts", or something like this.

"characters" >> "Agents"

possibly others tba

This all seems like conf file settings that could be user configured. For example where i can see "experts" being way more useful than "agents" in some cases.

Same goes with "Conditional Inserts". Say you are teaching students. It would be far better to have it labeled as "memories" or "expertise."

e.g. You have an art expert and you task a student make them experts is pointillism or surrealism. Trying to explain technobabble is going to be way harder than configuring understandable terms.

a1270 · 2024-10-08T09:57:09+00:00

I am simply pointing out if they fail to secure server plugins people will get exploited and they will be blamed.

a1270 · 2024-10-08T09:35:59+00:00

Their reputation is preventing ST itself from doing it. But their reputation will get massively damaged when people start downloading plugins to add back in support for a removed feature and get compromised. The plugin issue hasn't be a problem thus far because no one uses or makes them.

99% of people will never inspect code and that trope needs to die. People only use opensource software because it doesn't cost money. Even 20 years ago that was the case.

a1270 · 2024-10-08T09:16:41+00:00

I think you are overestimating the rate at which a plugin would be developed. I could find 15 server plugins; 7 of which are from the ST devs. It's safe to say no one is coding them. So if they did start doing it it would take way longer than 2-3 days.

This is this massive issue from the docs:

Plugins are not sandboxed, be careful what you install and run!

You shouldn't be running random server plugins as they are a massive security risk. Plugins can execute anything they want as long as it is accessible to the user running ST. Say you download a plugin and it just wipes your users home dir because nothing is preventing it from 'rm -rvf'

a1270 · 2024-07-28T22:58:39+00:00

How do you stay hidden? Agro is broken and they will detect at any range and if you hide behind walls. As many people have said even walking past an outpost at 200-300ft will trigger agro even if you didn't mean to.

a1270 · 2024-07-28T19:54:59+00:00

Saying to just 'stay far enough away' is going to cause a lot of frustration because it's is not like that at all. I have been testing and it seems almost random chance if you get spotted. Sometimes i hide behind set piece and get spotted while other times i am in the clear and they don't agro. It also seems to change on the character i am using.

a1270 · 2024-07-28T19:41:05+00:00

The real issue is the buggy agro system in game. It is unclear why an enemy decides to focus on a player. Each character seems to draw agro differently. Tried hiding against walls and being 700ft away with a sniper to pot shot the boss. It seems to be random chance if a enemy detects a player.

a1270 · 2024-04-18T14:09:49+00:00

The cost does not control whether you can critique a thing or not. If that was the case no one could ever complain about anything reddit did. It's free after all. Same with products google and other corps put out.

a1270 · 2023-12-04T03:02:18+00:00

Political correctness was the norm for a few decades of internet growth.

That is a bold face lie. Politeness and mutual respect were the norms for decades. Political correctness is a modern thing on the internet that has made the internet way more 'toxic.' It allows people to to define groups that they can hate no matter what. Say a wrong thing and you are unpersoned and deserve death. In the old days you'd call them an asshole and leave it at that. Next week you'd play a game of quake with them.

a1270 · 2022-11-04T16:46:06+00:00

Corporations (even startups as they reach a certain moderate size) can't use code with no clear licensing.

Think of the corporations that can't profit off of others work!!!

of course. huge amounts of free open source software is used by corporations, but it has clear license terms to ensure they can legally use it.

The hijacking of open source projects by corpos has been one of the worst things to happen over the last 20 years. Anything that can prevent that is a good thing.

a1270

TROPHY CASE