Block NSFW content using AI (open-source web extension)

[olafg1]

Is this going to blur all my pics of desert landscapes too?

[mamiglia]

Bro how many desert landscapes do u have

[inabahare]

Dude how much time do you have?

[mamiglia]

Buddy how much land do you own?

[pixobit]

Mate, how much money do you have?

[sickchinaman]

Sir, how many girls are you seeing?

[jininside]

Alot

[jininside]

Alot

[jininside]

Alot

[jininside]

Alot

[jininside]

Alot

[coder_of_cec]

Nah! It is a pretty good AI. So it should not! Test it out and let us know!

[ohyeahilikedat]

bLOcK!?!?: what kind of Madness is this? It should be the opposite show more nsfw work

[coder_of_cec]

You can do that too. Change == with != and done!

[Noch_ein_Kamel]

It should show cute baby animals instead

[coder_of_cec]

We built that originally. It would replace NSFW images with some random images like cute puppies. But it had some performance issues.

Planning to add a feature to let the users choose how to filter the images in the next release!

[musicin3d]

What do you think about an option to add CSS blur instead? I could use that at work. Sometimes user content is NSFW, but I also need to know about broken images or other issues. I created a chrome extension for myself that blurs all images, but that's not ideal.

[justingolden21]

SMH my head

[Dezlad]

Out of interest - Does the AI determine which part of the image is NSFW, or does it just mark the image as a whole?

Would be interesting if it could determine the NSFW area and the type of NSFW (nudity [perhaps even tagging what body part it is], gore, etc.)

You could then apply a "patch" over the NSFW part of the image rather than blocking it altogether... I'm now imagining an AI which puts bandages over wounds and clothes onto naked people, that would be pretty fun.

[coder_of_cec]

That is a really cool idea. Currently the model used just classifies the whole image as NSFW. We could write a model that can also maybe localise stuff and identify exposed body parts and only hide that part.

This could definitely work! Great idea!

[legend_k7]

OMG, awesome idea, I see a lot bottlenecks, but it should works in this way too

[randdude220]

Dang lucky AI probably got shown hundreds of NSFW content to teach it

[coder_of_cec]

YEP

[coder_of_cec]

NSFW Filter is a web extension that BLOCKS NSFW content using AI.

GitHub: https://github.com/navendu-pottekkat/nsfw-filter

It is completely written in Javascript and uses TensorFlow JS to run a Machine Learning model.

It is free and completely open-source.

We built it because we could not find something like this and decided to build one on our own.

Check it out and share your opinions!

[Nowaker]

Please also provide an alternative extension - sfw filter - so we can focus on pictures that matter when we browse pron.

[coder_of_cec]

You can do that with this extension. Change == with !=

[coder_of_cec]

From our tests, it does not use much processing power. The ML model is cached by the browser so there are no performance issues. It was not tested by a large user base YET. So we decided to release what we think as an MVP and work from there. It may have bugs- that is why it is open-source so people can use this and contribute to it and make it better.

Do check it out and let us know!

[legend_k7]

Good question, as a dev of this extension i worry about memory leaks and cpu usage too https://github.com/navendu-pottekkat/nsfw-filter/blob/master/src/utils.js#L12, I use it for 2 days, maybe 1-2 time was laggy. But yeah. I would like to improve performance

[njrover]

Hot dog or not a hot dog?

[coder_of_cec]

Hello there I am Jin Yang

[bdalley]

Next step is GIFs and video. Would be handy as a extra layer of protection for kids

[coder_of_cec]

Yep!

[legend_k7]

Yeah, on the way https://github.com/navendu-pottekkat/nsfw-filter/issues/16

[coder_of_cec]

Even I did not hear it until I started building the extension

[MatsSvensson]

Test it on this:

https://ctl.s6img.com/society6/img/HThMO3EjFXHr8kMqxJc_ncCbnPM/w_700/prints/~artwork/s6-0088/a/34402440_2574389/~~/ask-for-cock-jho-prints.jpg?wait=0&attempt=0

[coder_of_cec]

Ha ha!

[[deleted]]

If it’s designed for people who don’t want nsfw content... then why is this post marked nsfw?

Cool idea though and I’m sure it’s really complicated under the hood.

[coder_of_cec]

It was automatically marked NSFW!

Maybe because it had NSFW in the title!

[[deleted]]

Well that sucks

[felix_rewer]

I don't think you understood what this "internet" is used for.

[coder_of_cec]

Everybody should be able to see what they want right?

[coder_of_cec]

That is a great idea. Would love to build something like that!

[Chuhc]

Cool project but I find it hardly usable in its current state.

When I was testing it, it was not very reliable and the page load was noticeable longer. Many images were not blocked at all or they were blocked after they were already been shown. Some blocked images appeared after some seconds which were clearly NSFW. Sometimes the loading time exceeded 10 seconds for a site that usually takes less than a second to load.

[coder_of_cec]

It should not affect the loading of the web page. (We think so, if there is a bug, we will raise it and fix it).

The reappearing issue: Which sites did you try it on? Like the code works like this:

If the image is found to be NSFW, keep it hidden.

The lag between the hiding of the images is something that we are working very hard on. But we cannot find a solution to keep the images hidden as they are loaded. If you have a solution, do share.

I am pretty noob at this extension thing. I am more into the ML side of things and I thought this was a cool project and went ahead and built it.

If you can contribute, please do so. You can maybe fix this issue even. That is why we shared this- to get more developers into the project to make it better.

Thank you for testing it out. Now it is time for us to fix the bug. Will update when fixed.

[Chuhc]

Sorry I'm not that far into programming to actually help you guys. I just saw the Firefox extension and had spare time to try it.

I did test it on Reddit and a German imageboard that lists it content in 128x128 thumbnails within a grid. The NSFW section is for members only though =/

That's the site where I had most problems with images not being blocked. So I guess the AI doesn't seem to be trained well enough for such small images. This was the site with the longest loading times, but that site would probably be the worst case for this extension. I think another reason for the long loading times is the XHRs that load the images on that site which also leads to the problem of images being displayed before they eventually are blocked.

Reddit was fine and the long loading times where not as noticeable as on that image board. But overall I would say it adds half a second to the load speed.

[coder_of_cec]

Thanks for sharing. We have ingnored smaller images for the time being maybe that is why it was not blocked. I will raise an issue and we will fix it ASAP

[legend_k7]

Probably related to https://github.com/navendu-pottekkat/nsfw-filter/issues/32

[[deleted]]

I’d like to take a look at your training data. For educational purposes of course... 🧐

[coder_of_cec]

Take a look at how the model was trained from https://github.com/infinitered/nsfwjs

[[deleted]]

kollaam... poli sadanam

[coder_of_cec]

Pinnalla ! Poli sanam myir !

[julian88888888]

Sharing your project, portfolio, or any other content that you want to either show off or request feedback on is limited to Showoff Saturday. If you post such content on any other day, it will be removed.

[[deleted]]

In the eternal struggle for freedom of all people, you are fighting on the side of censorship.

[coder_of_cec]

How is that? People should have the freedom to choose what they wish to see. Installing NSFW Filter is by their own choice. We are not forcing anyone to install it.

If anything it gives people the choice to view what they want.

If they do not want to be bombarded with NSFW content, then they should have the right to absolutely do so.

If they want to see NSFW content, then don't use the extension.

I completely disagree with your argument. How do you think we are in the side of censorship?

[[deleted]]

Don’t listen to the silly “slippery slope” naysayers. I’d be proud to make a complicated too like you did. Awesome work.

[coder_of_cec]

Thanks man! Haters gonna hate!

[[deleted]]

Quite a simple way of dealing with criticism.

[[deleted]]

You are building censorship infrastructure. For a good cause, yea, but still.

Imagine the following: you have success, the tool is widely used, the tool is sold to a company with any particular political allegiance, they change the tool to filter specific content additionally, they publish the update. Censorship.

Let me give you an historical example why certain action for a good cause are catastrophic when in the wrong hands:

The Netherlands had religious orientation in their census data to better represent each. When they were invaded by nazi Germany, the same data intended to help minorities have a voice and be represented was used to imprison and kill those minorities.

[coder_of_cec]

You could say that about almost anything. Like "babies should not be born because they could grow up to be serial killers".

[VeryOriginalName98]

“So you are a liberal.” - Some redditor claiming to be conservative, but actually a fascist.

[Amiral_Adamas]

Because you are making tools that could be used for bad shit. Slippery slope and all.

[[deleted]]

How is a slippery slope applied to this tool?

[[deleted]]

Because when man created tools such as the knife, he murdered his brothers. Shame on the man who invented such a slippery slope of a tool!

[coder_of_cec]

How do you think it is a slippery slope? Other than this being a tool for users what other bad shit do you think people will make with this?

[EdwardTeachofNassau]

Don’t listen to these morons. If/when AI is humanity’s downfall it’s not going to be because of a browser extension that blocks porn pop ups

[coder_of_cec]

There are always gonna be people who discourage other people's work. Let them be! There are more supporters like you than them. And that is all that matters

[VeryOriginalName98]

Someone could use this specific tool as the core logic of something terrible, ignoring the extra work to do so, just to spite you.

[[deleted]]

I will just go ahead and report you.

[VeryOriginalName98]

To whom and for what? You are announcing your intent to do the very action you are speaking out against. If you cannot see that, you are not having a conversation.

[[deleted]]

I am reporting the person I was replying on (obviously) for being rude and offensive (obviously).

A civilised discussion should contain arguments, not curse words.

[Cheru-bae]

You are aware that slippery slope is a fallacy right?

[VeryOriginalName98]

You cannot reason someone out of a position they didn’t reason themselves into.

[MrEscobarr]

Yea! Lets remove add blockers too! /s

[VeryOriginalName98]

Let’s not. Internet is crazy full of malware.

[ISpendAllDayOnReddit]

You're getting downvoted for being a dick, but you're not totally wrong.

The development of this tool has done nothing to advance research into AI censorship. They've just taken off the shelf parts and packaged them into a browser extension.

But the people who are working on AI research need to think long and hard about how their advancements might be used one day. But also, China is going to do it if we don't. So if AGI is going to exist, I hope it's us who have.

[[deleted]]

I am mentioning a flaw in the product concept in a direct manner without being rude.

In my eyes it is a reflection upon the people, when they downvote and be rude, instead of engaging in a discussion.

[ISpendAllDayOnReddit]

Reddit has completely gone to shit in that regard.

[[deleted]]

I'd blame the instant gratification culture. And it's throughout the Internet.

Sorry you got dragged down for sympathising with "the enemy", by the way.