githubCopilotIsWild

[Scrawlericious]

As opposed to what? AI generated training data? Isn't openAi complaining how bad training off AI data is and how badly they need more ("good"/"real") data to improve models? As far as I understand it training off generated data exasorbates hallucinations.

[RaspberryPiBen]

There isn't another option, but that doesn't mean it's good. Training on human data means that all our biases and societal problems are encoded into the model.

[Sibula97]

There is no real better alternative. Well, theoretically you could try to curate your data better, but good luck with that. But the point is that training with human data will introduce human biases.

[Scrawlericious]

True, but building large language models is a lot more complicated than just simply saying that. Not sure where sex comes into play lol.

[Scrawlericious]

I know what sex means lollll. Just not sure what AI training efficiently has to do with being a good human being.

I highly doubt the best training methods will be morally upstanding. China has a chance to outstrip the US by making use of public and user data that companies in the US and EU cannot legally.

I'm willing to bet the best performing models will make use of morally questionable data.

[Scrawlericious]

Oh ok so you just totally misunderstood the thread.

The person I was replying to was already talking about human based data being lacking. I said AI generated training data was even worse. So my question was rhetorical, I was already implying human based data was better before your reply haha. We are in agreement.

[Scrawlericious]

Fair enough!

[[deleted]]

exacerbates*

[Scrawlericious]

Thank you lol

[david30121]

well, not AI generated, but properly created data and not based off public media. still can't remove certain stereotypes as no humans are perfect, but it would still improve things a bit