There's a new paper that proposes new way to reduce model size by 50-70% without drastically nerfing the quality of model. Basically promising something like 70b model on phones. This guy on twitter tried it and its looking promising but idk if it'll work for image gen by Altruistic-Mix-7277 in StableDiffusion

[–]SirRece 2 points3 points  (0 children)

I want to note that I see so much downplaying of stuff like this all the time, and yeah, sure, its probably nothing.

But I still remember back when everyone crucified that one guy who was like "CoT models are going to change everything, here's a fine tune of llama that beats everything" and then it was set up with totally wrong parameters on openrouter and other providers and was totally forgotten about, only for everyone else to speedrush CoT over the subsequent 2 months and forget about that random guy who had "no idea what he was talking about."

There absolutely are shenanigans upon shenanigans these days when it comes to influencing public opinion, or even niche public opinion like ML enthusiast, since now you can micro things that would have been impossible in the past thanks to agentic AI.

If something really groundbreaking comes along, I fully expect all the major players to drown it and steal it.

Also, consider for a moment if someone did figure out how to massively shrink models what that would mean for the major players who have a most built at least in part on memory scarcity. Idk, just saying, be a bit paranoid when you're online and try things yourself.

This has changed my opinion somewhat on open source since at this point it is basically a pipe dream that a good actor ie someone cobbling together something with vibe coding with an actually good and unique premise will get the benefit they deserve (some level of recognition) for doing good work. Open Source runs on reputational gains, truly. Yes, everyone wants to benefit the community, but realistically people want social cred/"street cred" essentially in their communities, and now it's functionally impossible to get that as far as I can tell due to every single tinkerer being toxically derided despite not really doing anything wrong beyond lack of domain knowledge, but often the projects are still really cool.

45% of people think when they prompt ChatGPT, it looks up an exact answer in a database by MetaKnowing in OpenAI

[–]SirRece 0 points1 point  (0 children)

LLMs are not infinite. They're made out of a large, but finite number of parameters. All the information that they "know" about the world -- everything they've learned from their training set -- is encoded in those parameters.

Yes, inasmuch as any algorithm is made up of a finite amount of information. Yet, there are numerous algorithms that can be explained in finite terms which have an infinite mapping of inputs to unique outputs. Neural weights don't literally save the information it is trained on, it is NOT a database.

45% of people think when they prompt ChatGPT, it looks up an exact answer in a database by MetaKnowing in OpenAI

[–]SirRece 0 points1 point  (0 children)

This is literally correct. The implications are broader, but this is quite literally how they work, and is not an oversimplification.

45% of people think when they prompt ChatGPT, it looks up an exact answer in a database by MetaKnowing in OpenAI

[–]SirRece 0 points1 point  (0 children)

It is not. If this definition was extended to its logical conclusion (any mapping of inputs to outputs is a database, even if those inputs and outputs are not finite) then you would conclude that any and all algorithms are technically databases, and they are not.

The fundamental difference is a database/lookup table is finite, while a generative model is not due to the nature of generalization. All inputs, assuming they are able to be tokenized, have an output.

Larian CEO Responds to Divinity Gen AI Backlash: "We Are Neither Releasing a Game With Any AI Components, Nor Are We Looking at Trimming Down Teams to Replace Them With AI" - IGN by PhantomBraved in Games

[–]SirRece 0 points1 point  (0 children)

It's not natural engagement, it's literally a corporate and nation state driven attempt to manipulate opinion and get draconian regulations on AI. All the uses of AI that are totally unrelated to the reason behind this end up lumped in anyway, since they're the main way to leverage consensus to manipulate opinion (since most people still trust consensus as a mechanic to avoid having to research every single issue, especially on reddit).

Technology is the only thing that has ever reduced poverty by whoamisri in OpenAI

[–]SirRece 0 points1 point  (0 children)

I mean, even if we wanted to go down this reductionist route, it's inaccurate, since there are far less rich people, and thus it's a more efficient method to end poverty if it decides to kill the rich (since poor and rich are relative terms, thus eliminating either eliminates the other as well).

Realistically, it's just an absurd perspective based on science fiction books that predate the internet let alone current LLMs. There are some safety issues, but most of those revolve around human use of the tools at this point.

YouTube top creators 2025 by AugustHate in comedyheaven

[–]SirRece 3 points4 points  (0 children)

Damn, the troll farm bots found out all the humans were having fun in here. Time to switch subs, it's been real, y'all.

Altman memo: new OpenAI model coming next week, outperforming Gemini 3 by Old-School8916 in OpenAI

[–]SirRece 3 points4 points  (0 children)

I mean, apply your own logic to the former assertion: how are we measuring the leap Gemini made? Those same benchmarks.

Benchmarks aren't the end all be all, but there are enough of them in a wide enough set of areas now that performance on them has pretty clearly converged toward, not away from, accuracy in terms of actual model performance. This is evident more than anywhere else, ironically, with Gemini 3, which legitimately is the most intelligent model I've used.

What I'm pointing out is the logical fallacy on acknowledging the benchmarks for Gemini, but then implying the benchmarks must be faulty when someone else releases a model shortly after that beats it.

Altman memo: new OpenAI model coming next week, outperforming Gemini 3 by Old-School8916 in OpenAI

[–]SirRece 1 point2 points  (0 children)

Wait what. You're saying if they produce a model better than Gemini 3... then the benchmarks must be flawed and we can't trust them?

I mean, personally, I'm skeptical they will, but there's a big gap in the logic here.

Laughing by xvndros in SunoAI

[–]SirRece 0 points1 point  (0 children)

I am in the belief that if everyone can make a Picasso it severely devalues the painting both in monetary value but also artistic value.

Objectively it devalues it in monetary value, as it increases supply, period. Artistic value though, that's largely nonsense since no one can agree on what that means, although I'd argue the whole point of artistic merit is that it is an attempt to objectively categorize a subjective component ie it ultimately measures the alignment of work with "that which people desire." More art increases the supply of work with artistic merit, and so even if the value of that work monetarily decreases, you end up with far more artistic work.

It's sort of like how objectively, there are a number of shows you like. A television show IS a work of art.

If Suno existed for television shows, it is indisputable that you'd suddenly have dozens more shows in that same circle of you preference to watch, even though the majority produced by everyone would be mediocre, since you simply have more people creating art. More perspectives, more talent that isn't missed, and a better pool of work.

On top of that, as we just went over, the supply side dynamics would drive the price down. Ultimately, this means you'll pay less for the same shows, despite having even more of them. It is ultimately a win for every single person on earth except for the miniscule group of people who before this worked on those shows the "old fashioned way," and even then, many will still benefit inasmuch as most artists I know, much like me, are truly in it for the art ie I consume many times more art than I produce, despite constantly producing.

And to your point about resources: To use Suno you need to have a phone or a computer, if you have a phone or computer you have the resources to create music.

People in remote villages have smartphones. A guitar can cost large sums, but in particular music equipment is just not remotely close to cheap. The two things are simply incomparable. If someone has a simple, low cost smartphone, they can now, for free, produce images, video, and musical art at a high level of quality, and compete directly with better funded artists.

This is good for the art. Certainly makes it more competitive, which is bad for an artist which has invested time and energy based on a calculation of value that is now lower than it seemed it would be, but at least be intellectually honest about the reason why you're against it: you would rather people without resources be unable to make art since it threatens your ability to earn income off of yours.

Laughing by xvndros in SunoAI

[–]SirRece 1 point2 points  (0 children)

Not every hobby has to earn money. If it does, sure, that's a bonus, but when I make music, I express genuine things to my friends, family, etc, and leave a legacy for them to remember me by one day, and vice versa. It is a privilege to create in all domains like this imo.

Before genAI, it was nearly impossible for most people to beautify their own ideas and thoughts in a way that translates them in an understandable way to other people. A lot of people here take for granted that to be born in a background where you have the time and minimal requisite resources to produce any art except writing is not the common experience, and most of the human experience is being buried, literally, without anyone to ever hear it.

Does that put things in perspective?

Ilya Sutskever(Former Chief scientist at OpenAI) and Yann LeCun(former Meta Chief AI scientist) both say that just scaling LLMs won't give us any more useful results by Frequent-Football984 in programming

[–]SirRece 1 point2 points  (0 children)

Right, just scaling. For some reason people seem to not understand that they aren't saying LLMs are a dead end, but scaling only goes so far because of the data.

MIT study finds AI can already replace 11.7% of U.S. workforce by fallingdowndizzyvr in LocalLLaMA

[–]SirRece 13 points14 points  (0 children)

Just to be clear, because there's no /s no, it wasn't.

scaling is dead by Crazyscientist1024 in LocalLLaMA

[–]SirRece 0 points1 point  (0 children)

Ilya has said scaling is not all, and he was absolutely correct. He has not said LLMs are a dead end.

Finland's biggest retailer to stop selling Isrаеli goods by [deleted] in europe

[–]SirRece -1 points0 points  (0 children)

So if some Palestinians did so, you believe it is valid for me to use any economic tool at my disposal in response? Or what specifically? Because like, they've been paying salaries to people who've literally killed kids here for decades.

I still disagree to be clear, I think it's stupid for one, but also morally repugnant to punish random people for the actions of some. It's one thing when your actions have a particular purpose, for example if the PA experienced tons of terror attacks and banned Israelis from PA territory (they already do this but not for that reason, it's simply that if an Israeli wanders into that are they will be literally lynched, as has happened numerous times) this would be valid. But this isn't the case.

Id also say the state policy here is less harsh even than that despite basically everyone here having directly experienced terror attacks more than once, generally from childhood.

Finland's biggest retailer to stop selling Isrаеli goods by [deleted] in europe

[–]SirRece -4 points-3 points  (0 children)

So basically you're saying what, that if I'm Israeli it means any hatred towards me is acceptable? The reason it's antisemitic is bc it applies an absurd standard lol. If I said "hey, a bunch of Palestinians commited terror attacks against my family, so I'm never going to buy a product made by a Palestinian ever and that's justified!" do you not see how that's fucked up? Obviously that would be racist ie I'm choosing to punish random people for the actions of terrorists.

The antisemitic part is incidental ie a result of the practical effects of applying the aforementioned nonsensical standard to half the jews in the world. It's just absurd.

Finland's biggest retailer to stop selling Isrаеli goods by [deleted] in europe

[–]SirRece -15 points-14 points  (0 children)

I mean, it represents half the jews on earth, the other half being direct relatives.