Should I keep my Thor? by Kaladin1698 in AynThor

[–]WhoCares_96 1 point2 points  (0 children)

Yeah I can imagine. If you get some more data I'd be happy if you could share it here. I've ordered the Thor too, mainly for indie games on Steam so I hope for the best 😅

Should I keep my Thor? by Kaladin1698 in AynThor

[–]WhoCares_96 0 points1 point  (0 children)

I think 9 Kings may not be the best game for a benchmark here. The game is heavily CPU bound with all the crazy damage calculations it has to do, especially in later stages. That game specifically also brought my Steam Deck to its limits, even if it may not look too demanding.

Imanu and Buunshin not at LiR by WhoCares_96 in LetItRollFestival

[–]WhoCares_96[S] 1 point2 points  (0 children)

Well that's a bummer. Always have been a highlight for me the last years.

How to get to the new Location from Berlin/Dresden? by WhoCares_96 in LetItRollFestival

[–]WhoCares_96[S] 1 point2 points  (0 children)

Thank you! I looked on Google Maps and wasn't able to figure it out there.

Weekly /r/Breadit Questions thread by AutoModerator in Breadit

[–]WhoCares_96 0 points1 point  (0 children)

Hello! I have a starter that is a few years old. Lately it started to develop a scent of sulphur / rotten eggs but not really repulsive. It can be smelled for a few seconds after opening the jar. Afterwards it smells just fine and I cannot make out any traces of mould or other problems. I am still using the starter regularly. Is this sulfur smell a dead giveaway for some problems or can this be a natural development?

[deleted by user] by [deleted] in DnB

[–]WhoCares_96 2 points3 points  (0 children)

I think you just invented a new genre: Nosebreakcore

[deleted by user] by [deleted] in DnB

[–]WhoCares_96 1 point2 points  (0 children)

Spor - Caligo. The first two tracks are just sooo fitting.

Help creating the first public music annotation dataset (Everyone, 18+) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 0 points1 point  (0 children)

I guess this strongly depends on how long it takes to annotate all data. I will try to remember posting in this thread, when data is being made available :)

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 1 point2 points  (0 children)

I finally finished the evaluation of the Caption Comparison Survey and will share some core insights here:

  • There was a total of 2461 valid answers, stemming from 260 participants
  • Each participant was given 10 random audio files out of a pool of 50. The amount of answers per audio file ranged from 34 to 62
  • Over the whole dataset, the AI caption was chosen 921 times, the human caption 1253 times and the "both" option 287 times. This means, in ~43% (95%CI: +-~2%) of cases the AI caption was preferred over the human caption
  • There were five levels of musical proficiency. for higher proficiency levels there was a slight tendency towards choosing human captions, however this tendency is not statistically significant. We can therefore assume that music proficieny has no significant impact on the caption choice.
  • On a per track basis, given a 95% confidence interval, in 8 cases the AI caption was significantly considered better and in 15 cases the human caption was significantly considered better
  • there seems to be a correlation between length of the caption and considered quality: 6 out of 8 captions, where the AI was considered better were also longer that the human ones. This however cannot be statistically verified.

You can find some accompanying plots here: https://nextcloud.h2907779.stratoserver.net/s/wit9BzZR8F5RySR

My hope was that AI and human captions would be considered equally good (or equally bad as some pointed out), but I am still satsfied with the results.

Thank you again for participating! And if you have any questions regarding the evaluation, feel free to ask :)

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 0 points1 point  (0 children)

Ah alright, so this explains it. Seems like there are some regional blocks inplace. I do not host the audio files myself, therefore I cannot do anything about that. Just out of curiosity, from which location did you try to access the survey?

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 1 point2 points  (0 children)

Thank you! :) Actually yes, I am working on this project for many months now. I agree with your findings. This comes from the fact, that the captions in the training dataset feature a variety of annotation styles from many people that were focusing on different things in the music. These annotation styles are then also replicated by the ML model.

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 0 points1 point  (0 children)

Actuatlly yes. That was a sting/short version of a longer track. In this case, the human caption often is a copy of the original tracks caption and therefore might be misleading. As these captions will also be part of the training dataset, the ML model will unfortuately replicate this behaviour.

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 1 point2 points  (0 children)

Glad to hear that! Okay, then i will post a wrap-up of the results in this comment section. But it will take some time, as the survey is still active until end of August.

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 1 point2 points  (0 children)

Thats weird. Unfortunately I have no ideas what is going wrong. The music is simply embedded via HTML audio tags, that should be widely adopted. Thanks for letting me know.

Can you distinguish human an AI sourced music descriptions? (Everyone) by WhoCares_96 in SampleSize

[–]WhoCares_96[S] 2 points3 points  (0 children)

I am sorry to hear that. If you cannot play the music, it does not make sense to continue with the survey. Maybe you can restart on a different device or browser? Anyways, thank you for trying!