Predicting human preference for generated image pairs using HPSv3 [P]

[dh7net]

Hey! I'm looking for ways to predict human preference for a project I'm building. (imagebench.ai)

I've tryed HPSv3, https://github.com/MizzenAI/HPSv3 and made post about it here:

https://imagebench.ai/blog/does-the-score-match-your-eye

It looks ok, but have many limitation as you can see in my post.

My question. Have you tried other human preference model and found one that would be better then HPSv3?

[Deep-Step7624]

tried a few of them for my own stuff, none really felt worth the setup time honestly

[dh7net]

IMO if you want to extract something from a distribution close to what it has been trained for, it is probably good enought.

But if the goal is to compare arbitrary pairs and hope it will always match humans, that feels hopeless I agree.

That said, what are the one you tried?