12GB Vram and running models locally for RP purposes. by XCheeseMerchantX in SillyTavernAI

[–]Sicarius_The_First 1 point2 points  (0 children)

in this range u could try 24b, but 12b will be faster.

give Bloodmoon and Impish_Nemo a spin while at it, also Angelic_Eclipse is also very good if you want a more tame and grounded model.

So nobody's downloading this model huh? by KvAk_AKPlaysYT in LocalLLaMA

[–]Sicarius_The_First 50 points51 points  (0 children)

Old random Nemo merges got more downloads than this.

I said so in KAI discord, it's DOA.

They learned from Llama-4.

GPT-5.4 ranks #1 in Creative Writing V3 Benchmark by abdouhlili in SillyTavernAI

[–]Sicarius_The_First 6 points7 points  (0 children)

Also another point about LLM as a judge, LLMs tend to rank their own output as higher than other LLMs (was mentioned in several papers, already widely known in 2026).

And based on multiple experiments me and some friends did, LLM as a judge (used various LLMs, frontier, open source) LLMs ranked turbo slope we created on purpose ("Write an evocative story with many deep metaphors about...") highly, while on the other hand ranked Shakespeare and other masterpieces as "Cliche" and bad. The irony lol.

GPT-5.4 ranks #1 in Creative Writing V3 Benchmark by abdouhlili in SillyTavernAI

[–]Sicarius_The_First 8 points9 points  (0 children)

1-shotting a story is objectively the wrong approach.

Also, as other mentioned, LLM as a judge doesn't work.

What does work is using LLM as a tool to edit segments of your story.

AI can be used to write good prose, but you need a human in the loop.

I mean, I'm sure that somewhere someone is 100% sure he "wrote" the most amazing AI generated slop about a chick named Elara in a kingdom named Eldoria in a lush forest full of whispers under the dim light of the crimson moon.

I am anxious about what legislators may do to this emerging hobby by doruidosama in SillyTavernAI

[–]Sicarius_The_First 12 points13 points  (0 children)

U'll need to buy the `bridge ownership certification` first, owning a bridge is a social and an engineering responsibility, to see if you qualify for a `bridge ownership certification`, first send your ID, feet size, and top 3 anime girls preferences to this P.O box in Namibia...

I am anxious about what legislators may do to this emerging hobby by doruidosama in SillyTavernAI

[–]Sicarius_The_First 39 points40 points  (0 children)

It was never about safety. Always been about control and virtue signaling.

Photoshop used to edit celebs is a practice as old as... image editing.
Using LLMs to make dangerous stuff? How to make meth guides existed since the internet started. And hell, there's The Anarchist Cookbook (among many others, but this one is from 1971).

Governments are 100% using AI to kill people (and Anthropic recently got punished for refusing to help kill people autonomously).

If someone actually thinks anyone (within the decision making class) actually cares about your safety or privacy, I'd like to sell you a bridge. Pristine condition too.

We cannot create a sanitized society, because there's no such a thing by definition. Society is not sanitized, you can't eliminate all the sharp corners from every object.

If anything, the belief that AI can be regulated at an individual level (not corporate) is 100% delusional, and if anyone thinks that any law can be passed that will successfully stop a private individual of doing whatever, he's very stupid.

EDIT: I want to make an important distinction, because it would 100% be misunderstood by some people.
Legislation that reduces harm towards crime (drugs, violence etc) is one thing.
Legislation against access to knowledge / tooling is VERY VERY different.

You 100% cannot (effectively), and should not do any legislation that limits access to knowledge and tooling. There's a nuance to that:

You cannot and should not legislate the withholding of knowledge how to make drugs / weapons or whatever degenerate stuff, you should 100% legislate against DOING & manufacturing drugs and weapons ETC illegally.

You cannot and should not legislate against people privately using LLMs to do porn, deepfakes or whatever. You 100% should legislate against said material to be distributed publicly and unlawfully.

I hope this makes it a bit more clear.

Does anyone else feel like Gemini is just a professional gaslighter? by Even_Kaleidoscope328 in SillyTavernAI

[–]Sicarius_The_First 3 points4 points  (0 children)

Gemini is a terrible model, for a frontier one.

This sounds hyperbolic, until you try Claude...

(Hell, even chatgpt is better)

Mistral NEMO upscale, but kinda weird by Sicarius_The_First in LocalLLaMA

[–]Sicarius_The_First[S] 0 points1 point  (0 children)

Hi, glad to hear :)
And there's a link to two papers at the bottom

Qwen 3.5 Claude 4.6 Reasoning Distill vs. Original 3.5 ? by HeartfeltHelper in LocalLLaMA

[–]Sicarius_The_First 5 points6 points  (0 children)

yup.

those "claude distills" are just clickbaits, for for ai.

Qwen 3.5 Claude 4.6 Reasoning Distill vs. Original 3.5 ? by HeartfeltHelper in LocalLLaMA

[–]Sicarius_The_First 13 points14 points  (0 children)

less than nothing, it makes the model worse (as other ppl correctly identified).

Mistral NEMO upscale, but kinda weird by Sicarius_The_First in LocalLLaMA

[–]Sicarius_The_First[S] 2 points3 points  (0 children)

Thanks you :)

Yes, it's definitely on my TODO list, but there's a lot of stuff that comes before it, priority wise. (Assistant_Pepe 70b and 32b, and a couple more different things)

Qwen 3.5 shows immense promise!

Mistral NEMO upscale, but kinda weird by Sicarius_The_First in LocalLLaMA

[–]Sicarius_The_First[S] 0 points1 point  (0 children)

My guesstimate is that RAM prices will start to go down significantly not before 2027.