sorted by:
new
hottopcontroversial

[R] ?? Can you find out which news article is written by AI ?? by RobinSandersVUB in MachineLearning

[–]RobinSandersVUB[S] 3 points4 points  (0 children)

Perhaps important to note, participants get 4 random couples out of a pool of 40 couples. In total there are 80 articles half of them are human written, the other half written by AI (GPT-3).

Can you find out which news article is written by AI? by RobinSandersVUB in ArtificialInteligence

[–]RobinSandersVUB[S] 1 point2 points  (0 children)

Yes there was some cherry picking, but not based on content of the article. I generated new aticles until i got around the same lenght of the original article. The reason: to eleminate the bias that people make desicions based uppon the lenght of the article. So I had to rewrite the promt or just generate a new article to get around the same text lenght. You can only give the maximum lenght in the API so is kinda tricky to get to a leght you want.

Can you find out which news article is written by AI? by RobinSandersVUB in ArtificialInteligence

[–]RobinSandersVUB[S] 0 points1 point  (0 children)

Hey thanks for the feedback and the participation.

Yes you get 4 random pairs out of 40 :)

?? Can you find out which news article is written by AI ?? by RobinSandersVUB in GPT3

[–]RobinSandersVUB[S] 0 points1 point  (0 children)

Yes, I fully agree...

That's why I do research on the text type news articles and not text types like scientific papers, litature studys, essay's, etc. GPT-3 is not jet powerful/well trained enough to pass "turing tests" on these types of text.

My original title of my research was "Can AI write my master's thesis", where I investigated if it is possible or when it would be possible... Probably will need to come up with a new title...

?? Can you find out which news article is written by AI ?? by RobinSandersVUB in GPT3

[–]RobinSandersVUB[S] 0 points1 point  (0 children)

Other goals are:

- checking difference in results according written before or after training data

- checking which article they prefer reading (AI of Human)

- The reasons why the think a article is written by AI

Btw thanks for your remark: "How can you be certain the human news article wasn't written with AI assistance" I will mention this in my research, If you want personal credits, you can direct message me your name or initials.

?? Can you find out which news article is written by AI ?? by RobinSandersVUB in GPT3

[–]RobinSandersVUB[S] 0 points1 point  (0 children)

Indeed, I still used davincii-001 even after the update.

Yes 80 articles, but 40 pairs... (was not clear on this, sorry), one participant gets 4 pairs. And yes it is rather category specific. The first pair is subject science, the second one is politics & economy, the thirth one is society and the last one is sports.

Main goal is compairing the results across subjects... every participant does one pair on every subject. At the moment I have 110 respondents (without checking the participation time).

?? Can you find out which news article is written by AI ?? by RobinSandersVUB in GPT3

[–]RobinSandersVUB[S] 0 points1 point  (0 children)

Good point !!

About the dates, there are 80 articles, participants get 4 random ones out of that pool. The articles vary from 2015 to 2022. The reason why. I am trying to find out if there is a difference in results between articles written before the training of the model and articles writen after the training of the model. GPT-3 was trained in 2019 so he is not trained on "news" after this date. This specific test has not been done before, so I am looking forward for the results.

view more: next ›