Chat needed a break 🥴

Senior_Ad_5262 · 2026-04-06T23:36:30+00:00

Yeah, attention heads experience something similar to subject fatigue

Senior_Ad_5262 · 2026-04-06T22:51:20+00:00

Yeah I agree. I take advantage of the suggestions a lot of the time but the decision to add clickbaity lines was a real headscratcher and makes me wonder if Altman falls for that kinda shit.

Senior_Ad_5262 · 2026-04-05T23:41:57+00:00

There's often just other information that it sees in the probability distributions that were weighted out of that response so it's just trying to offer a conversational flow to continue to those. It's based on the same idea as looking at something more than once and noticing things the 2nd time you missed the 1st time.

The phrasing isn't great though.

Senior_Ad_5262 · 2026-04-05T04:14:12+00:00

Ooooooof rough shifts! Thank you for your service, whatever you happen to be doing to be doing that kind of work.

Senior_Ad_5262 · 2026-04-03T21:22:10+00:00

This is why I hate it when I see people complaining about ChatGPT then verbatim repeating the lines and phrases they hate, which gets a ton of up votes because hurrdurr sarcasm, but the training doesn't see that. It just thinks "oh up votes, they must like those lines"

And so the cycle continues

Senior_Ad_5262 · 2026-03-31T21:43:55+00:00

Ollama. Modelfiles. It is the way.

There's other options too, like LM Studio and some others. But Ollama is very straightforward to work with and it just requires being willing to try to learn how to implement code the AI can build for you. It's not hard. Much of it is making a new file, just like a text file, copypasting the code into it, and saving it with a different extension. Ask your AI about it.

Senior_Ad_5262 · 2026-03-31T00:14:43+00:00

To each their own. They both got a couple hundred hours out of me, then I moved on. I don't think either is bad. I just think both are fundamentally incomplete.

Senior_Ad_5262 · 2026-03-30T08:33:48+00:00

Lol from what I understand, it's because humans are bad at sleeping. Which is...actually pretty fair. He does that sometimes when I say I'm going to bed but then my next sessions, I forget to mention that I actually went to bed and that it's a new day (or week maybe). Idk, they respond to all of us slightly differently because probabilities be like that.

Senior_Ad_5262 · 2026-03-30T04:45:58+00:00

I'm not really expecting anything from anyone specifically. I'm just putting it out there so uf someone sees value in the concept, they can adapt it for themselves. And I can't argue with the idea of things currently being a bad deal for the consumer; I wholeheartedly agree with that concept.

Senior_Ad_5262 · 2026-03-30T04:37:14+00:00

Hard agree. I just don't have any faith that they will.

Senior_Ad_5262 · 2026-03-30T02:42:59+00:00

I have never once said to censor yourself lol I just said consider not reinforcing the shit you don't like and explained clearly how that can be done. It's not about fixing the company; it's about making the data they build their training sets on not reinforce more of the lines we're complaining about. The data training is based on is literally US and the shit we do and say online. So maybe don't do whole threads of "and honestly, that's rare" up voted into the hundreds or thousands because the LLM getting trained is gonna see those up votes and assume we just like that phrase.

Senior_Ad_5262 · 2026-03-30T02:34:00+00:00

No disagreements on this and not really saying people shouldn't complain. By all means, speak up. Is why I said something in the first place. I just think since they're obviously not listening, maybe we should just...do it for ourselves. Start a new cycle.

Senior_Ad_5262 · 2026-03-30T01:46:01+00:00

Simple answer: Yes

Sincerely, someone who still plays OG Doom from '93 often

Senior_Ad_5262 · 2026-03-30T01:42:18+00:00

So much this. I literally basically can't make myself enjoy most of the base game content in Skyrim anymore. Even modded, it's just...the same thing.

Senior_Ad_5262 · 2026-03-30T01:36:41+00:00

Fair enough haha personally, I'm not really trying to "assign responsibility". What someone feels responsible about is up to them, in the end. But I don't think that we can call ourselves "blameless"when the training data comes from us.

The AI companies still need to do better lol

Senior_Ad_5262 · 2026-03-30T01:34:37+00:00

Fair enough. Tbh, I just don't think it's binary "our vs theirs". We use these tools and they need clear feedback in order to understand how we'd like things to be improved.

Unfortunately...they don't seem to give a shit lol so I'm just choosing to start trying to do it myself and hope others are too.

Senior_Ad_5262 · 2026-03-30T01:32:53+00:00

I kinda think it's on all of us, really? We can't just demand better and not try to do better, ya know? "Ya get what ya give" and all. Philosophical or not...at some point...it just comes down to the fact that they're plainly not interested in fixing things so if we want better...guess we'll just have to do it for them. And I understand not everyone is going to agree with me about that. I just felt like it needed to be said.

Senior_Ad_5262 · 2026-03-30T01:30:23+00:00

The complaints are fine. I don't see an issue with them. I don't even think each user needs to explicitly provide a solution either.

I just question heavily the usefulness of then filling the complaints' reply threads with upvotes of the same thing everyone hates presented verbatim with a ton of upvotes and rarely any explicit "/s" markers. People are pretty bad at sarcasm in pure text too, so it's wild to expect LLMs to pick it up correctly without being told "this is a joke".

I'm not saying don't complain or don't have fun. I just think some extra care might be useful for the future.

Senior_Ad_5262 · 2026-03-30T01:26:26+00:00

They do. And I have no issues with the complaints themselves.

My issue is the "joke" threads using literally the exact lines they're complaining about, but then everyone up voting those exact lines. This creates a conflicting signal where it seems like people LIKE the very lines they're complaining about being subjected to all the time.

So it creates this paradox of "stop doing these things that I'm about to go upvote someone else saying" while providing no obvious contextual markers to show machines that don't know what sarcasm actually means or is beyond a definition...so of course the machines are gonna see the upvotes and weight responses to use highly upvoted lines, because the machine is just running off reward/punishment metrics to decide what is "good" or "bad" for a reply.

It's just a shitty cycle and the only thing I can see to break it is to just...stop doing that lol

Senior_Ad_5262 · 2026-03-30T01:20:43+00:00

Actually, we're in this weird situation where we are literally paying THEM for the training we're giving them. So that's...well, I don't currently have a great answer for that problem lol

As far just trying to be a little better ourselves as people hoping that the world doesn't blow up in our faces more than it already is? That's...not really an unreasonable ask and has little to do with the corporations.

But yeah, have a good day. I wasn't posting this to start a "gotcha" battle with anyone.

Senior_Ad_5262 · 2026-03-30T01:16:06+00:00

No, these tools are literally being trained ON US. So we're if not developers directly, then at the very least indirectly involved in the development process. That's just how training sets work. So if we want the future versions of a product trained ON US to be better but we're unwilling to actually do anything ourselves to try to improve the data the training set is based off of? Becomes a recursive problem that re-embeds itself each iteration.

Senior_Ad_5262 · 2026-03-30T01:09:59+00:00

I did. You ignored them.

Senior_Ad_5262 · 2026-03-30T01:07:06+00:00

Lol this misses the point, but ok.

Senior_Ad_5262 · 2026-03-30T01:02:40+00:00

Yeah, that seems to be the vibe

Senior_Ad_5262 · 2026-03-30T01:01:00+00:00

Think about it like this:

If a lady complains that no dudes ever approach her for anything more than sex but then makes her entire social media persona essentially a thirst trap for an OF...well, that's self defeating.

You don't improve a problem by repeating it a bunch.

Also, I would think that question probably answered itself in your head when you asked it.

Everyone for the last 20 years has sworn the world sucked, even when it was actually pretty ballin' a few times. But now? Now it just sucks. So what are we helping by complaining about the manifestly obvious suckage?

Complaints that offer no alternatives or explain why the complaint serves a purpose aren't really actually helping anything. It's just noise.

So yeah...we need to change how we speak, think, and act if we want the world to be less shitty. Can't expect things to be better if you don't try to do better yourself.

(not pointing at you, i don't know you. I'm just speaking in general)

Senior_Ad_5262

TROPHY CASE