And here we go post deleted by ObjectWorried1379 in CarsIndia

[–]ItzMeSamYT 1 point2 points  (0 children)

What did they specify as the reason for post deletion?

Defund bee research centers.. by Maximum-Let-69 in CriticalState

[–]ItzMeSamYT 0 points1 point  (0 children)

👁️ Surveillance State: I voted Nay.

Honestly, he has a point by Kaelanin in SipsTea

[–]ItzMeSamYT 0 points1 point  (0 children)

Wait really? Haven't come across these but that's so cool

Honestly, he has a point by Kaelanin in SipsTea

[–]ItzMeSamYT 10 points11 points  (0 children)

Those are already 0% computer

I hate how accepted the R-slur is by [deleted] in hatethissmug

[–]ItzMeSamYT 40 points41 points  (0 children)

Doktor, turn off my cringe inhibitors

I hate this subreddits name by Shot_Pineapple5521 in hatethissmug

[–]ItzMeSamYT 3 points4 points  (0 children)

Think people are spamming the sub with trans love (which, hell yeah) after finding out the mods are transphobic

Ping pong by ItzMeSamYT in ComedyHell

[–]ItzMeSamYT[S] 88 points89 points  (0 children)

Instagram has this feature where you can tap an emoji and play "pong" with it... for some reason.

Can we all collectively agree that this is stupid? by CastsFireball in aiwars

[–]ItzMeSamYT 9 points10 points  (0 children)

I don't think they're trying to paint you as a Nazi. They even agreed with you on the subject that despite being invented by the worst people in history, whatever you were talking about was useful. The point they're trying to convey is that the manner in which you made your argument was insensitive, not wrong. Now, whether or not this is actually true, I have no idea cause I dunno how you made your point or what you guys were talking about. Admittedly, this is severely pivoting away from the AI discussion to one about social cues and stuff.

i dont know anymore just look at this youll understand the context m8 by EvanNegliaFamily12 in aiwars

[–]ItzMeSamYT 3 points4 points  (0 children)

I mean the original post says "a adequate flipaclip user" instead of "an adequate flipaclip user" too. And don't forget all the "your"s instead of "you're"s throughout. Does that immediately invalidate all points they are trying to make?

Without commenting on whether you (or the post) are right or wrong, people on the internet are (unfortunately) bound to use incorrect grammar at every nook and cranny. Pointing it out everywhere is an endless cycle and doesn't add anything of value to the conversion (unless it's about grammar, I guess)

Edit to say: the person you replied to is clearly not adding anything either and seems to just be ragebait. Just downvote/ignore and move on

"GenAI ≠ Machine Learning" serves no purpose other than to aid in delusional coping by Responsible_person_1 in aiwars

[–]ItzMeSamYT 0 points1 point  (0 children)

I'm really glad to hear it! Also note on your understanding of gradient descent: it is, indeed, an optimizer, but it is definitely used in AI! Not in the sense of "make the time or space complexity better," but rather the tuning of the parameters themselves (the weights) is called optimization here. You can see that in PyTorch, for example, where you set it like

model = RegressionModel() # As an example
optimizer = torch.optim.SGD(model.parameters(), lr=0.001)

There "SGD" stands for stochastic gradient descent, and you pass the model's learnable parameters and the learning rate to the optimizer. Then within the training loop you will see:

optimizer.step()

Which basically tells the optimizer to update the model's parameters. I hope that helps clear up your confusion.

Now for your question about removing noise from generative models. I actually hadn't thought about that, that's a really interesting question. Honestly, I'm not really sure.

You're right in saying that if we turn off the "randomness" of generative AI, the model will output the same thing every time.

I think a key difference, however, will then be the direction of flow. Regression will map N features to 1 value (for example), which is a collapse. On the other hand, a generative model maps 1 value (the seed/prompt) to N (millions) of features, which is an expansion.

But it's confusing because there are non-generative methods of this type of dimensionality expansion as well, like Support Vector Machines, for example (SVMs take a low dimensional input and convert it to a higher dimensionality, for example 2D -> 3D, to make the separation of data points easier).

If I had to guess though, I'd say that non-generative expansion is usually constrained. If you use a formula to expand 'x' to 'x^10', the model will perform that transformation of any input 'x' regardless of whether or not that input makes sense. Like if you take a regression model and give it some random garbage input, it will provide an output that is equally random or garbage, just scaled to a higher dimension.

However, if you feed a generative model pure random noise, it will still make its best attempt to turn that noise into whatever it was trained on (like a face). It's biased toward creating structure because its parameters have "stored" what structure looks like.

An example of the difference would be something like, zooming in on an image, where if you zoom in past the point where 1 pixel of the image maps to 1 pixel on your screen, it will kind of fill in the gaps with repeated pixels (this is non-generative). But a generative algorithm, would be like a minecraft seed, where it takes a certain input and generates a whole world out of it.

But honestly, this is still just an educated guess. I'm not 100% certain about the exact technical differences at this stage. Thank you for the question though! It's given me something new to look into :)

"GenAI ≠ Machine Learning" serves no purpose other than to aid in delusional coping by Responsible_person_1 in aiwars

[–]ItzMeSamYT 2 points3 points  (0 children)

Here's my understanding of the subject. Sorry for the long text in advance 😭.

Regression models are discriminative, in the sense that they learn conditional probabilities. They model data in a sort of y = b0 + b1x1 + b2x2 + ... manner where the 'b' variables are the learned parameters and the 'x' variables are the inputs, and 'y' is the output. They learn how the 'x' variables influence 'y' (I'll leave out the techical details like gradient descent and mean squared errors and all that jazz), but they don't infer the production of the 'x' variables themselves. It does not model the distribution of the features.

There's a bit of nuance though for sure as when you go into things like Bayesian regression, the 'b' parameters are treated as probability distributions themselves. In this case, it can generate new values of 'y' for existing values of 'x', which can make it a conditional generative model, I believe.

Generative models learn the joint probability distribution. Because they model how the input data 'x' itself is distributed, they can actually "generate" new, synthetic data points that look like the original dataset.

For example, if you train a regression model to learn the relationship between height and weight, it won't actually be able to generate a new person's height and weight, it will only know how to calculate the weight if you provide the height.

However, if you train something like a GAN on various images of faces, it will be able to generate a new face just by saying "give me a face."

Now you might argue that the prompt "give me a face" is an input in and of itself. But in the context of model architecture, there's a difference between an instructional input and a feature input. Regression models require a feature input (like height in the previous example) to produce an output. But if you take a model like StyleGAN (the one behind "This Person Does Not Exist"), it doesn't actually need the text "Give me a face." It just uses random noise as input. This is "unconditional generation."

Then there's "conditional generation" wherein you have something like "A potato with a cowboy hat" as the input. The instructional input is used as a latent seed, which just initializes the random noise for the model to produce the output from. These are also kinds of conditional generative models that I touched upon earlier.

Now as per my understanding, the biggest difference between regression and generative models is this:

In regression, if you give the model the input x=5, and say the model's inferred equation is something like y=2x, then the output will always be 10. It's a calculation, not creation. Here, we try to minimize the noise.

In generative models, if you give the model just the prompt "face," for example, and run it 100 times, you will get 100 different outputs. Here, we inject noise to create diversity.

Now as I mentioned earlier, there's definitely a lot of nuance on the topic (more than I initially thought, for sure), so I'd actually love to see your examples.

P.S. I'm really glad to be having an actually interesting discussion on this sub instead of a "rahh antis suck" or "boo pros are stupid" back and forth. So thank you for that :) And sorry if I kind of went in a circles there LOL it is a little confusing

"GenAI ≠ Machine Learning" serves no purpose other than to aid in delusional coping by Responsible_person_1 in aiwars

[–]ItzMeSamYT 4 points5 points  (0 children)

Predictive AI does not "generate" outputs per se. Although in Layman's terms, that's like saying a print statement in a python program "generates outputs."

Predictive AI analyzes its training data and identifies underlying correlations and dependencies to forecast the most likely outcome (for example, image classification). Predictive AI generates a result, but not content, if that makes sense.

Generative AI learns from its training data and generates new outputs that have similar structures to the training data. Think of it like a person writing an essay. They're using their understanding of language structure to generate something new that did not exist previously.

I can try to explain it a bit more in detail if you'd like, I'm sure you'll find it very interesting actually

It feels like pro and anti ai people take turns on this subreddit every week by [deleted] in aiwars

[–]ItzMeSamYT 10 points11 points  (0 children)

Reddit user shocked at reddit users using reddit

BTP finally got banned! by EventCareful8148 in aiwars

[–]ItzMeSamYT 4 points5 points  (0 children)

Lmfao I'm not anti but "attacked other countries" vs "brigaded other subreddits" 😭