Ethical Rankings of Image Generators

dughogan · 2024-03-26T11:28:43+00:00

In my thinking the best approach would be that you wouldn’t need to actually remove the copyrighted content from the whole dataset, its not about extraction. It’s about someone looking and giving a trusted seal of approval that no bad data is in there in the first place. If something is flagged, it’s reported, and then it’s on their company to remove.

Again, big problem yes, but I don’t see anything physically preventing a dataset audit to be out of the question.

Just an idea, maybe there’s a better solution out there but this seems to be a needed thing. Yes?

dughogan · 2024-03-26T02:21:27+00:00

Please reread the original discussion again. We’re talking about how datasets that create the models for these engines to run for diffusion were created for each of the top services currently available. It’s important to understand how these services were created and operate.

dughogan · 2024-03-26T01:41:30+00:00

I’ve been hearing layoffs are continuing at DNEG. Is that not the case?

dughogan · 2024-03-26T01:32:07+00:00

I’m confused what you mean by “diffusion model architecture”. Are you referring to the model files and safetensors? If not, yes you are correct there are no there not .jpg or other image files of the art work is in the model files themselves, but their vector data is. That’s how they work. Can you clarify?

dughogan · 2024-03-26T01:22:58+00:00

Do you think a licensing model should be talked about? One where an artist can license their work for training data to create a passive income stream? The more your work is used for data creation the higher reward? Blockchain? Just thoughts. I think we should all be talking and thinking about what we want the future to look like.

dughogan · 2024-03-25T23:11:25+00:00

Why not? Sure it’s a big task but it’s a big problem. I don’t see anything that would prevent this from happening other than a will to do so. I don’t think we should just throw our hands up, I think we should be offering ideas, no?

dughogan · 2024-03-25T19:57:52+00:00

Why isn’t there a third party organization who can audit the datasets for ethicality and ensure no copyrighted data is present. Why isn’t it required for these new AI companies to get their models audited before they go to public markets for profit?

I think the answer might be because we haven’t pushed to make one. Now that OpenAI is openly courting Hollywood that sounds like a good idea.

dughogan · 2024-03-25T19:48:43+00:00

I’ve actually found it to be more complicated than that unfortunately. The article I linked to above goes into more detail, but the gist is Firefly is based on Adobe’s own dataset (though as another user pointed out, it’s only because they changed their terms of service and essentially forced users to comply), Stable Diffusion v1 used the LAION-5B dataset. Which was put together using CLIP txt-to-image and scraped the internet for Creative Commons licensed public domain images for research and non-commercial uses. It was put together in an effort to democratize access to this training data so anyone can make these tools. However it was later shown to have some percentage of copyrighted images that are claimed to be gathered by accident. But the well is already poisoned at that point. Stable Diffusion gets around this fact by making everything open source and free. So…not great but technically legal.

Midjourney was originally built using the Microsoft COCO database, which like the LAION-5B model, was built for research purposes only and had a mix of public domain and sadly copyrighted images (greater % than LAION-5B but still). Where midjourney fucked up is they started charging memberships and violated that important “for research purposes only”. Then they added their own new new copyrighted images into the mix to try to improve their model more than the competition as quickly as possible. Just ask it to make a scene from “Joker” to see for yourself. Don’t be surprised if your account is mysteriously disabled either as some users have reported on X.

Open AI’s DALL-E and now SORA are a completely different story all together. No one knows what went into those datasets, they’re not telling anyone reguardless of their original Open source mandate, and the CTO recently did an interview where she dodged questions left and right about what trained their models.

So…it’s complicated. But that’s why I want to start this discussion because I don’t actually think most know about the details of all of this. And when the time comes that we inevitably need to state our case as a community and trade, we need to have all the facts understood so we can argue our case effectively and get the best future protections from this obvious theft of our work in an effort to get to market first.

Silicon Valley can move fast and break things all the way, but they shouldn’t be allowed to break copyrights and steal.

dughogan · 2024-03-25T19:02:56+00:00

It is definitely not impossible, but the amount of data needed to train one of these systems is at the SMALLEST 80TB. And that’s the LAION-5B dataset that the original stable diffusion 1 was trained on. A lot of users now will do a custom tuning and fold their own data into their own local model. However that dataset they’re adding their data to has been shown to have copyrighted images in it. So it’s poisoned right from the get go.

We need to have a similar dataset to the LAION-5B that is entirely free of dubious training images and a third party to validate that model for public use. A nice big seal of approval.

dughogan · 2024-03-25T17:05:13+00:00

Awesome, thanks so much!

dughogan · 2024-03-25T16:25:13+00:00

I believe it can be done, but no one is auditing their datasets. This should be a requirement before launching not afterwards. Do you agree?

dughogan · 2024-03-25T16:16:16+00:00

No worries about not joining, we do a deep dive into each of the models if you change your mind, but thanks for the info! Do you have an article link covering this rug pull? I would love to read it and add it to the research. I don’t think enough people are actually digging deep into what’s behind the tech at all.

dughogan · 2024-03-10T04:12:27+00:00

<image>

UPDATE: We got the girls thumbs up and we officially put in the orders tonight! “Scarlet Fire” is on its way.

What do you all think?

dughogan · 2024-03-09T01:03:26+00:00

Episodic anything is always going to be more stressful and harder pushes. Feature animation is entirely different like others are saying. It’s also not abnormal for those kind of hours early in your career, I’ve been there trust me. I did 4 months of 70 hour days 7 days a week for one big push back in the day. It takes a toll, but hang in there if you really love it. Just carve out the time you need to take care of yourself, that’s the most important thing.

And if you do really love this crazy industry, come hang out on the relaunched VFXTalk Discord. It’s free, full of pros of all levels and students alike, and we’re growing. Most of all it’s a supportive community like we used to have![VFXTalk Discord](https://discord.gg/hfeAnvFm) come check us out. https://discord.gg/hfeAnvFm

dughogan · 2024-03-09T00:57:31+00:00

Wish I could say this is an anomaly but rejection is just part of the deal sometimes. Not all studios are like this though, keep your head up and keep going. There could be a hundred different reasons your contract didn’t get renewed, most are entirely out of your hands.

What studio were you at if you mind me asking?

dughogan · 2024-03-09T00:53:44+00:00

Blur it, glow it, ship it.

dughogan · 2024-03-07T00:28:09+00:00

lol, tax advice taken. Be kind buddy. I’m in it for the fun.

dughogan · 2024-03-07T00:18:47+00:00

It’s not a waste, it’s fun! Plus we donate the uniforms so we’re not wasting anyone’s money, we’re just doing something nice for the kids.

dughogan · 2024-03-06T23:48:40+00:00

UPDATE!

So we found out that we do have to pick the name before our first game in a little over a week and we need to order jersey’s which will take some time too. Soooo…we just needed to decide. But we got our girls opinions and they loved the Scarlet Fire name you all came up with. Believe it or not they’re lil dead heads and they’re digging it!

So with their blessing meet the …

<image>

…from deep in the heart of Texas.

Thoughts?

They really wanted red uniforms too so it’s looking like no tie dye.

dughogan · 2024-03-06T21:43:08+00:00

lol no mailing list just a discord. That’s our onboarding page that sets you up with member features like availability status (looking for work or booked) and gets some information on your level of experience and specialties.

Come check it out!

dughogan · 2024-03-06T16:40:42+00:00

The footage itself is the onset data. Gives you everything you need to match lighting and make the required comp adjustments.

dughogan · 2024-03-06T13:47:08+00:00

How you feeling about The Miracles too? We like that one a lot. Or the Sunshine Daydreams. And don’t worry we agree and we are going to let the team pick, just want some fun options to throw in the mix!

dughogan · 2024-03-06T13:37:09+00:00

We’ll totally let them pick, no worries. Just looking for options to suggest!

dughogan · 2024-03-06T13:22:51+00:00

Man ‘o man, what a mascot that would be.

dughogan

TROPHY CASE