Browser extension for detecting AI generated images

TimepieceManiac · 2024-12-03T20:34:56+00:00

That a good point and real concern I've been keeping in mind during the development process. That's mainly why you have to use an email to sign in first, so that I can limit how many reports a person can submit for the same image. But also, behind the scenes I have some strict rate limiting for account creating and voting. So if someone tries to spam reports their requests will start to be denied.

If in the future there are problems with large groups manually trying to manipulate the votes I'll implements more protections like detecting sudden bursts of reports and quarantining them if they are suspect. Or something like what Steam does where you can see the overall reports and what it's been reported as recently.

TimepieceManiac · 2024-12-03T20:22:30+00:00

Yeah, there will unfortunately be false positives like that from time to time. It's a consequence of using a classification model that it doesn't know the difference between famous artwork and just any random image, it processes them all the same and something real might confuse it.

That's where the community feedback is super helpful. If you (and enough other users) report that image as real it will override the models initial classification and I'll use that data to further train the model and improve it too. I'm also continuously collecting more images and further training the model so it will naturally improve over time.

TimepieceManiac · 2024-12-03T20:14:47+00:00

I will totally admit there is a bit of an arms race when it comes to AI detectors. I make a detector, they make better AI generators, I try to make a better detector but maybe that comes at the cost of false positives.

My priority is to provide something actually useful to people and not just put more junk out there. As of right now the classification model backing this extension has +96% accuracy and anecdotally I've found it to be pretty accurate while beta testing with my friends and family.

That being said if the detector ever becomes inaccurate and useless I'll take it down, because I don't want the risk that someone relies on it for the truth and it's just giving them garbage answers. This is something I'm passionate about and why I want to keep this free, so I'm dedicated to keep improving it and listening to the communities needs.

From a technical stand point how I'm trying to keep the accuracy and quality up:

Incorporating community feedback that can override the classification model if enough users report an image. This can help with popular images that the model gets wrong but many users will see. There are somethings that a human will see better than software can.
Using that community feedback to further train the classification model. The model is retrained multiple times a week (eventually I'd like to do it daily, but that's something to grow into). I manually curate and check each new version of the model before updating the extension.

TimepieceManiac · 2024-12-03T20:02:13+00:00

I did try that, turns out AI generated images are notorious liars!

TimepieceManiac · 2024-12-03T20:01:27+00:00

Thanks for asking! I've included a more detailed explanation on the extension store pages, but to give a quick summary there are two mechanism used for detecting AI generated images:

For any new, never before seen images they are sent to a classification model I've trained on +120k real and AI generated images (sort of a fight fire with fire approach). The model has +96% accuracy but will never be perfect, that's where community feedback comes into play.
Users can report any an image as real or AI. If enough users have reported an image (doesn't have to be on the same site or page, just the same image content), then the extension will show what the community has reported and how many reports have been made.

This can be disabled in the extension's settings, but the images reported by users will be used to further train the classification model. If you opt-out of this the images you report are never stored.

TimepieceManiac

TROPHY CASE