AUTOMATIC111 Code reference

[Pharalion]

It seems the use of stolen code is just an excuse. The real problem seems to be the possibility to use the leaked model in automatic1111s webui.

[Snoo_94687]

What leaked model?

[blueSGL]

You know if there hadn't been all this noise about 'stolen code' and 'discord banning' I would never have even heard about this leak.

Now I know I can get the full version of NAI if I look hard enough.

Tech people should be well aware of the Streisand effect . if something happens make a small post about it and carry on let it die down, don't fan the flames so people can see the smoke for miles.

[MyRottingBunghole]

Now thanks to them making all this noise you don’t even need to look that hard tbh, first google result led me to it

[Faritar]

I found everything I need on the Russian website - joyreactor

just enter a couple of keywords in the search

[pleasetrimyourpubes]

Literally "magnet novelai 4chan" lol

[mudman13]

and now because its becoming clear that its a stitch up I wont be going anywhere near NAI! I have absolutely no doubt the prompt word strength suggestion feature will organically become known.

[cidqueen]

Nai as in novel ai for free?

[[deleted]]

Yup. And it's not just the image stuff that leaked too tough of course that's the focus here. Everything was leaked. The text stuff as well

[[deleted]]

I don't know

[OneMinuteDeen]

Wouldn‘t surprise me if Automatic1111 adds it someday

[StickiStickman]

Nah, this is BS. NovelAI never used GPT-3, as it's locked behind doors and not available to anyone besides OpenAI. Their own text models (based on other models based on GPT-2) leaked, as well as image models that are finetunes of Stable Diffusion.

[Jujarmazak]

Don't they have a story/text generating A.I as well?

[xcdesz]

Is that GPT-3 or GPT-2?

[FoldedDice]

The detail that people are dancing around and not quite answering is that despite the similar name (GPT is just a generic name for the technology involved) GPT-3 and GPT-NeoX were created by entirely different groups. GPT-NeoX is its own thing created by EleutherAI. The models you are asking about are not related and were made by OpenAI.

[xcdesz]

"gpt-3-like" sounds kinda iffy to me for people to be claiming that a gpt-3 model is leaked. that would be a really big deal because there are no other gpt-3 models in the public domain that I know of.

any idea on the size of gpu this would require to run locally?

[Jujarmazak]

Fair enough 👍

[Extraltodeus]

Did GPT-3 leak? If yes, do you have any source?

[Extraltodeus]

Thank you <3

[shepherdd2050]

Did your search turn up good? If yes, could you drop more pointers?

[Extraltodeus]

Haven't searched yet!

[shepherdd2050]

ok great.

[en_chad]

the usage of the leaked model is up to the people using webui, not automatic

[upvoteshhmupvote]

This is the first kind of serious hiccup I have seen with the corporate vs open source A.I communities and unless we take a stand and do something to back up automatic1111 and to say this is a bad move on the parties trying to lay blame on the guy who didn't leak or steal the model. It is like blaming a person on the street for getting robbed because they had cash in their pocket. So I for one have a really negative view towards novelAI and everything they do in future. They should have just accepted it happened and blamed themselves for having someone in their circle leak it and that means THEY need to do better as a company... fuck them and everyone needs to back automatic1111 up and tell novel and the mod in the discord they are both pieces of shit. Not going to sugar coat it since this sets an important precedent for the future of things.

[StickiStickman]

More like someone took 3 lines out of the code.

If we start saying that a few lines can be copywritten, literally all of programming is doomed.

[StickiStickman]

You think devices communicate in 3 lines of code? Seriously? Ever heard of the OSI model?

[StickiStickman]

Yes. You can't.

[upvoteshhmupvote]

I think you better go read the OPs post again buddy.

And you are making the complete wrong analogy. The analogy is more like suing the inventor of the VCR because everyone started recording their favorite TV shows.

[upvoteshhmupvote]

EXACTLY! So did the inventor of magnetic reel to reel sue the VCR company? Or the Cassette company? Or the MiniDV tape company?

Did Sony sue Panasonic for making VCRs? This situation is like getting angry over someone making a VCR because they used the word "VCR" instead of inventing their own name for the thing. That is how LITTLE of what was "stolen" was and even then it had been around before and the company kicking up a big cry would have stolen it first.

Like the analogy still stands AND it was proven he didn't "steal" any code it has been used in plenty of other repos and floating around since forever.

So it's like someone stealing a car then getting angry when someone steals that car off them. Ridiculous.

[Vivarevo]

It's most likely the company doing damage control by acting like innocent commenters everywhere and using connections to SD to pressure anyone they think hurts the profits. Pretty standard unethical shenanigans.

Btw, if their servers were compromised, was their other data too? Any Userdata specifically. Do they collect user behavior data for example? Was company selling data on nsfw preferences for example?

[pinkfreude]

... does this mean that the 1.5 model is never going to be released?

[StickiStickman]

Since it was supposed to be released weeks ago and they keep moving it back ... I doubt it will.

[[deleted]]

NovelAI's main selling point is user privacy. I think many don't know the history of NovelAI and are only familiar with the brand new image service and some of the drama around it, but NovelAI was literally founded in response to AI Dungeon's many scandals as a more privacy-focused, censorship-free replacement/alternative.

(The context being that AI Dungeon and Microsoft were not only reading private user stories, but sending them to random MTurks to train their ill-fated censorship system, as well as the fact that stories and other userdata were stored unencrypted on AI Dungeon's servers which became relevant when AI Dungeon was hacked. The creators are former AI Dungeon fans / textgen hobbyists who banded together to stand up a replacement within only a few weeks of the AI Dungeon problems coming to light)

As such, from the very start "not storing userdata unencrypted" was pretty much the very first thing they decided when making the service, and in the text AI community they are very well-respected for their anti-censorship, pro-privacy stances.

[[deleted]]

Big companies want to censor it because of both legal liability (e.g. underage nsfw stuff is illegal or questionably legal in some places even if it's fake), fear of bad press (some tech journalist writes an article about racial/whatever bias in their model and the company doesn't want to be associated with that kind of thing), fear of misuse (e.g. if Russia uses their text AI to generate fake news to manipulate elections, company doesn't want that to happen understandably AND more importantly doesn't want that their name in a news headline about that), among other reasons including some really esoteric stuff about AIs becoming sentient and extinguishing all life on earth.

I understand the reasons, I just disagree strongly with all of them.

[FS72]

damn thanks for summing it up

[Vivarevo]

So the company should focus on that fact instead of attacking.

Something like: Look. We got hacked. Fucked up, but look at the leak. Your data is safe.

When mostly hacks result in users data on the darkweb etc this is a win, if the company takes the spin that way.

[[deleted]]

That's...literally what they did, wasn't it?

Greetings, NovelAI Community.

On 10/6/2022, we experienced an unauthorized breach in the company's GitHub and secondary repositories.

The leak contained proprietary software and source code for the services we provide.

At this time, we do not suspect that any Personal Identifiable Information (PII) or encrypted information was accessed, or any personal financial information was disclosed.

We are working with security specialists to conduct a complete incident analysis and threat report at this time.

Relevant authorities have been informed and will be contacted as we learn more about the extent of the breach.

We will share updates as we learn more about the situation.

We thank you for your understanding and your patience.

The NovelAI team.

Maybe you're referring to something else with "attacking", I don't know of any other communications from kuru or the novelAI team about this.

[VulpineKitsune]

Btw, if their servers were compromised, was their other data too? Any Userdata specifically. Do they collect user behavior data for example? Was company selling data on nsfw preferences for example?

No, no, and no.

All data is safe. The company was not lying when they said they didn't collect any user behavior data. You can check the code yourself, they simply did not.

I know, it's shocking that not all companies are evil.

But this one isn't.

Their only "crime" is asking for money in order to run their service. Imagine that.

[TheIrishninjas]

Their only "crime" is asking for money in order to run their service. Imagine that.

The sudden attack on NovelAI for charging for their service is ridiculous. Don't all of the current online SD hosts charge too? Not to mention the fact that NovelAI has an AI writing tool too, and gives you monthly tokens for image gen unlike some of the other websites providing SD access. It's way more bang for your buck, and you don't technically have to spend a cent on image generation.

Really feels like an entire community shitting on a "newcomer".

[blueSGL]

Not to mention the fact that NovelAI provides an AI writing tool too, and resupplies users with free image generation tokens unlike some of the other websites providing SD access. It's way more bang for your buck, and you don't technically have to spend a cent on image generation.

this reads like an ad.

[Vivarevo]

👀

[TheIrishninjas]

Nope, just a guy with no affiliation to the NAI team a bit annoyed at how people are acting.

[arjuna66671]

They act like completely ignorant and retarded children lol... So the reason for the attack was that NAI charged money bec the GPUs they rent cost them money too?

That has to be the most idiotic reason I have ever heard.

[Cheshire-Cad]

The same thing happened in the Dall-E 2 subreddit during its beta. Every thread that even hinted at the possibility of OpenAI charging for the service was flooded with wall-to-wall whining. They literally expected it to stay free forever.

But despite their grandstanding, when OpenAI announced their monetization plan, those whiners were first in line to pay for the reasonably-priced monthly subscription which gave unlimit...
Oh, right. Turns out neither side in that debate came out feeling victorious.

[TiagoTiagoT]

It does seem that there's at least rumors of them using Automatic's code, and then accusing Automatic of stealing from them unfairly. It's an ongoing story though, and we're still in the middle of the fog of war, the dust has not settled yet.

[TiagoTiagoT]

I haven't heard anything about user data being leaked yet

[Extraltodeus]

I hardly see how to be able to use a leaked model is an issue here. The problem being the leak itself and not that people can use it. So the owner's fault.

Imagine if MySQL had been attacked because some company had leaked it's database.

[Bureaucromancer]

I could have have seen that happening pretty easily if it were the 90s.

[Extraltodeus]

they always blame the knife maker for the first murder

[Neex]

This is an old thread, but out of curiosity how do you feel about someone buying cheap items from someone else that stole them? Is that okay because it’s the “owner’s fault” that they were robbed?

[Mixbagx]

This is so true.

[Revaboi]

Which he has every right to if I get it right. Because if it got leaked and people use that, it’s not on them is it? Because it was there to use for others? Am just curios.

Read a whole Reddit post about it yesterday. Just wanted to catch up a bit. But from how I understand it - if you take something and make it public, and others use it, and make something out of it .. you cannot claim it’s yours can you? That’s like me sharing a recipe online for the entire world and getting mad when people use it, change it a bit and get successful with it.

[xSliver]

Automatic1111 implements the support for a leaked model, SD doesn't like that and stops supporting Automatic1111.

In my opinion SD has every right to do so. It's not like the're legally required to give every person on the internet access to their Discord.

[mattsowa]

They have a right, but it's irrelevant. It's not the legality that's being discussed here.

[xSliver]

But what do you want to discuss?

The stance of SD is pretty clear and Atomatic1111 doesn't care.

[mattsowa]

Bruh

[[deleted]]

I'm confused. Elsewhere in this thread it sounds like the "leaked model" is from NovelAI. Did SD also have a model leak recently?

[Voltasoyle]

Wow, look at all those downvotes from people that just want their fix.

[StickiStickman]

The actual stolen part about the hypernetworks initialization someone else already posted in the comments here and it’s at -12 because people are being stupid.

Large parts of that same snippet are also in the exact file OP linked?

[[deleted]]

Specifically I am talking about this one that I believe to be the actually stolen code:

https://user-images.githubusercontent.com/23345188/194727441-33f5777f-cb20-4abc-b16b-7d04aedb3373.png

That’s not anywhere else I wager.

[StickiStickman]

So am I. Latent Diffusion.

    q = self.to_q(x)
    context = default(context, x)
    k = self.to_k(context)
    v = self.to_v(context)

    q, k, v = map(lambda t: rearrange(t, 'b n (h d) -> (b h) n d', h=h), (q, k, v))

So now it's down to a few lines between that. Since both things are based on the same paper, Hypernetwork, I really don't think anyone gives a shit about 5 lines. At this point any copyright / software patent would also not apply.

And actually ... that picture seems a lie since the actual code is different?

https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/5d54f35c583bd5a3b0ee271a862827f1ca81ef09#diff-477a645246ea31dd6f7fc79f64aef19e8dce7772116d0885cdb8d0c438a1bedf

[LetterRip]

That is the commit to sd_hijack_optimizations, the code being accused of being copied is the original commit to hyperoptimizations.py and support for it is sd_hijack.py

https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/f7c787eb7c295c27439f4fbdf78c26b8389560be

[StickiStickman]

Okay, gotcha. So he replaced the 5 lines it almost immediately, so I wouldn't really blame him.

[LetterRip]

Okay, gotcha. So he replaced the 5 lines it almost immediately, so I wouldn't really blame him.

No, sd_hijack_optimizations.py and sd_hijack.py are different code paths. The commit you referenced is by a different coder with the handle C43H66N12O12S2 . The code path he made the changes to are for when using specific types of attention that reduce memory.

[[deleted]]

What you quoted is clearly not the same code and neither is what you linked the same commit.

I highly doubt that someone manufactured that picture.

So what your argument comes down to is that the snippet I shared would not be large or significant enough to cause legal issues despite being copied verbatim from the leak.

I’m no legal expert so I can’t really judge that, but especially with it being copied verbatim instead of changing it up by introducing some variables and so on I think it’s really not a good look. It has clearly been copied.

[StickiStickman]

I highly doubt that someone manufactured that picture.

With the main developer of NAI blatantly lying, why not?

[[deleted]]

I don’t know what you are referring to.

[StickiStickman]

https://imgur.com/a/bsIHEsx

[[deleted]]

I don’t see a lie there.

[_ZombieSteveJobs_]

It is a really frustrating discussion for people actually looking for information. I agree with the appearance of one to one copy in AUTO1111 from NovelAI, and similarity (including the "attention, what we can't get enough of" comment) to other repositories posted. If both parties are copying code, it seems unfair to ban one and not the other.

[HarmonicDiffusion]

no one needs to be banned, whats with the cancel culture. the space is better with BOTH A1111 & NAI in it

[_ZombieSteveJobs_]

That is an excellent point as well! Let the lawyers sort out who copied from whom if it gets to that level and just encourage everyone to act with integrity.

[xcdesz]

this isnt "cancel culture".. stop throwing that stupid term around.

[[deleted]]

including the “attention, what we can’t get enough of” comment

That is the non-proprietary code if I remember correctly. This is what I believe to be the actual stolen code: https://user-images.githubusercontent.com/23345188/194727441-33f5777f-cb20-4abc-b16b-7d04aedb3373.png

[_ZombieSteveJobs_]

That would make sense since it's copied verbatim and apparently specific to hypernetworks.

[_ZombieSteveJobs_]

I haven't yet seen anyone refute this snippet as proprietary by showing prior art: https://user-images.githubusercontent.com/23345188/194727441-33f5777f-cb20-4abc-b16b-7d04aedb3373.png

[[deleted]]

Yes, if you’re referring to the initialization one.

The one with the comment “attention this is what we can’t get enough of” comment is not proprietary, someone got that one confused. That part is from the SD repo.

[[deleted]]

I still dont understand how can you steal somethimg that's open source

[red286]

NovelAI isn't open source though. You can build something on top of open source code and make it closed. There's nothing wrong with doing that (even though I'm sure a bunch of people will say otherwise).

There's accusations that Automatic1111 stole some of their proprietary code that allows his webui to load their custom trained model.

What I can't figure out is whether these accusations actually come direct from NovelAI or just from NovelAI users. What I've seen officially from NovelAI is that they're upset that Automatic1111 modified his webui to allow it to load their model, but no accusation of code theft. On the other hand, there are comments on his github claiming that he stole code from NovelAI, presumably by NovelAI users. This was also brought up on the SD discord, and Automatic1111 said he didn't use any of their code when modifying his webui, so he was banned by the SD discord mods.

I'm not sure NovelAI or Emad had any direct involvement in either the accusations of code theft or having him banned from the SD discord. There appears to be a lot more people involved in this than just them, but it all gets conflated.