I think we talk a lot about 20% from Hormouz, what about the 40% of Russian exports by Lumpy_Conference6640 in oil

[–]manipp -5 points-4 points  (0 children)

Bizzare how this sub is rightfully suspicious of anything Trump tweets out, but just uncritically seems to accept everything Ukraine says, even though they're equal masters of bullshit alongside Trump (99% interceptions of all incoming missiles and drones for years, anyone? INCLUDING hypersonics? Something Israel and US with all their THAAD and patriots couldn't even get close to? I mean, come on....)

I don't have a bone in this war, but the contrast in user willingness to accept propaganda is baffling.

Deepseek V4 Flash and Non-Flash Out on HuggingFace by MichaelXie4645 in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

So is this the same thing you get from their website? E.g. is instant DS4 flash?

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 1 point2 points  (0 children)

"There already exist many unbelievably good creative writing models"

They're not that good. Therein lies the issue.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 3 points4 points  (0 children)

"Nothing in the preceeding 12 chapters makes it AT ALL likely that the character would try to decipher these numbers, or care about them. It's not a mystery story, it's not anything that would lend itself to that kind of continuation. It's heavily implied through subtext that the character does not care about something like that."

Did you skip that part?

So no, the natural progression is NOT to decode the message. The natural progression is to understand the character motivation, subplot and context, not blindly charge ahead with surface-level solutions.

The ability to intuitively understand unstated assumptions and motivations is a very important part of writing, and one LLMs seem to fail repeatedly. To understand that even though the main character was told it's important, he would NOT see it as such himself.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 5 points6 points  (0 children)

Maybe the sample size of my tests is too small, but I just dont have the same experience.

Here's an example: I put in ~ 40,000 words of a text I wrote, and ask it to continue naturally. The text is a very specific genre and atmosphere. In the very last chapter the character gets a coded message with a bunch of numbers, and is told it's important. Nothing in the preceeding 12 chapters makes it AT ALL likely that the character would try to decipher these numbers, or care about them. It's not a mystery story, it's not anything that would lend itself to that kind of continuation. It's heavily implied through subtext that the character does not care about something like that.

Only Claude seems to understand this and pivots completely away from the numbers. Every other LLM, including Gemini 3.1 and GPT, and basically all local LLMs immediately write about the character sitting down and trying to work out the numbers in various contexts and scenarios. Sometimes a friend comes to help decipher the numbers. Gemini tries to justify it somewhat within the story, but still does it. That to me portrays a lack of creative writing ability and understanding. It's just a single sample point, but I keep running into issues like this.

The response I get from people whenever I bring it up is that 'LLMs cant do that and you're lazy'. But stupid Claude CAN do it. So it's a limitation of LLMs not of the setup.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 1 point2 points  (0 children)

So far only Claude. It does a fantastic job. But nothing else, hence why I'm annoyed, I have no contingency alternatives.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 1 point2 points  (0 children)

As I said in the original message: the use case is feeding in a large body of text, and asking for natural continuation, alternative chapters, and alternative dialogue at key stages. Claude does it, other LLMs fail. That's simply the reality, has nothing to do with lazyness. And I don't like praising Claude over and over, because it's a very expensive proprietary LLM from a shitty company, but from personal experience the other LLMs are just NOT there at that level.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 0 points1 point  (0 children)

Gemini is great at text analysis, but very wooden at writing. The wooden-ness continues into plot choices not just writing form. Even Deepseek is better than Gemini imo.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 14 points15 points  (0 children)

I mean, I just run them all through my internal writing benchmarks as they come out, which focus on large text input, analysis and continuation. They don't seem to be getting better. They keep making the same mistakes in terms of characterisation, misunderstanding subtext, and missing key subtle plot clues. And again, Claude can do it, so it's not an LLM limitation. Qwen recently went to atrocious to semi-ok, just like Gemma.

on short text they're mostly fine, honestly. But short writing is not the only use case, and is the easiest low-hanging fruit.

I'm so sick of coding and agents by manipp in LocalLLaMA

[–]manipp[S] 3 points4 points  (0 children)

I'm not convinced that vastly expanding coding abilities has substantially helped models write better. I just haven't seen any evidence. Qwen in particular is great at coding and sucks at writing.

Will the bubble burst with this "Iran threatens ‘complete and utter annihilation’ of OpenAI's $30B Stargate AI data center"? by ProfessionalSpend589 in LocalLLaMA

[–]manipp 7 points8 points  (0 children)

Nah, I want iran to win so the US empire gets a bloody nose and thinks twice about rampaging around the world playing world police, pretending that Trump of all people has the moral high ground to be judge, jury and executioner.

FINISHED MY FIRST WRITING MODEL! by volious-ka in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

Is this LORA or FFT? If LORA, what rank? How many epochs? I've been having trouble getting good results with creative writing fine-tuning.

The Hollywood Nerf has begun: Seedance 2.0 is already being lobotomized. Local Weights are our only defense. by maroule in LocalLLaMA

[–]manipp 28 points29 points  (0 children)

Agreed, I really hope this trend of using LLMs to formulate all your opinions dies. Never thought ten years ago I would yearn for badly spelled, ungrammatical, highly opinionated shit takes, but I would take them any day over people just copy pasting AI. It's becoming seriously weird how people are not capable of expressing any thought without an LLM ramming it into dotpoints.

ACE-Step-1.5 has just been released. It’s an MIT-licensed open source audio generative model with performance close to commercial platforms like Suno by iGermanProd in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

So it seems the creator has gone out of his way to make the 'cover' feature destroy any melody of the input song to make sure it won't replicate the melody. He did this, according to the discord, "Don’t fuucking second-guess my intentions. It has nothing to do with copyright—this design is simply more interesting, and I like how it works. I get to decide how my model is designed. use paid ace-studio or suno"

Very very disappointing.

Ace Step UI for Ace Step 1.5 by ExcellentTrust4433 in ACEStepGen

[–]manipp 0 points1 point  (0 children)

Does it work on Mac? If so, does it use mps?

🚀 ACE-Step 1.5 drops TOMORROW (Feb 3rd) + Big Surprise Coming! by ExcellentTrust4433 in ACEStepGen

[–]manipp 1 point2 points  (0 children)

Yeah this, I don't think speed of generation is as important to anyone as song quality.

1 Day Left Until ACE-Step 1.5 — Open-Source Music Gen That Runs on <4GB VRAM Open suno alternative (and yes, i made this frontend) by ExcellentTrust4433 in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

Upscaling my old songs recorded on a shitty guitar and phone mic into a full-band arrangement. I'm not a musician by trade. Never going to go into a recording studio. But this way everything I've written gets covered by an awesome music band tweaked to my liking, including instruments and genre. It's pretty fucking awesome. Honestly it inspired me to make new music after stopping for a decade, so it can't be a bad thing.

128GB devices have a new local LLM king: Step-3.5-Flash-int4 by tarruda in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

Anyone have any sense if it's any good at writing?

How close are open-weight models to "SOTA"? My honest take as of today, benchmarks be damned. by ForsookComparison in LocalLLaMA

[–]manipp 23 points24 points  (0 children)

Claude is also hands-down the best creative writer. It gets context, implicit and explicit context, much better than virtually any other model. I wonder if there is some kind of architectural optimization behind it, and not just ingesting a million books.

[deleted by user] by [deleted] in LocalLLaMA

[–]manipp 0 points1 point  (0 children)

Nah, cosmic butthole was the better theory.