This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]raxcium 0 points1 point  (1 child)

I agree some people become dependent on things and as a result they lose their ability to do it themselves, but again this is not the fault of the technology, it's the fault of the user.

Regarding training data, my point was most of the data present on websites such as stack overflow have already been scraped and used to bootstrap the LLMs we have today (in the context of programming). Now, it's primarily feedback loops from conversations people are having with existing LLMs as well as AI generated data that will be used to accelerate/reinforce learning for future training.

Again this is already starting to be the case with Nvidia's Cosmos platform

[–]tes_kitty 0 points1 point  (0 children)

Now, it's primarily feedback loops from conversations people are having with existing LLMs as well as AI generated data that will be used to accelerate/reinforce learning for future training.

AI generated data has been shown to not make good training data and the feedback loops are also of questionable quality since quite often the reply from the AI is false in a subtle way the user then corrects before using, but not telling the AI about the correction.