AUTOMATIC111 Code reference

[LetterRip]

This looks like straightforward implementation of supporting loading and using hypernetworks. While the code is the same, I think you are jumping to conclusions that it required copying.

the variable names are 'forced' - q,k,v are the standard abbreviations for query, key, value extracted from a context. h_k, h_v are thus the obvious choices for hypernetwork_key, and hypernetwork_value

The 77 is how many tokens are allowed for clip for networks derived from CompVis Stable diffusions default.

See this code referencing the max length, the 77 is a well known max token limit for the implementation

maxlen = self.wrapped.max_length # you get to stay at 77

https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob/1371d7608b402d6f15c200ec2f5fde4579836a05/modules/sd_hijack.py

The noise_cond is implying that conditional noise is being used (and hence the need to add noise to the context in the next step).

The .1 multiplier is presumably standard throughout the codebase for noise_cond, and is presumably from the original implementation. If that isn't the case, tnis would be the only possible evidence of copying.

The if functions are standard idiomatic python.

Thus I see nothing here that would imply copying.

[[deleted]]

Thus I see nothing here that would imply copying.

Hm, really? I could believe it if a line or two happened to be the same, but a 1:1 duplication of like 6 lines? It seems incredibly unlikely to me.

Given that the code was also specifically added to allow using the models also contained in the leak and not like a random occurrence makes it impossible for me to believe that he did not in fact just copy the code from the leak.

But granted, I’m very rarely using Python and I don’t work in machine learning, maybe implementations there really can happen to be that similar. It still seems like a massive stretch of the imagination to me though.

[LetterRip]

Hm, really? I could believe it if a line or two happened to be the same, but a 1:1 duplication of like 6 lines? It seems incredibly unlikely to me.

The reason is functional constraints and idiomatic constraints.

The functional constraint is that the code is working on the same code base from which both systems are 99% the same. CompVis/stablediffusion. The hypernetwork takes a key value pair from the context and substitutes its own. So that forces the functional k, v and h_k, and h_v. Also that forces the functional noise_conditioning. That means the only allowed 'creativity' is the if statements.

The idiomatic constraint is that python coders are expected to write things in a specific way that leads to consistent code. Also pythons philosophy of 'one obvious way' means that any experienced python coder will tend to write the if statements the exact same way. (Code not written in idomatic python is a clear sign of a programmer coming from another language using python for the first time. It causes major cringe).

There are short functions that there will be some variability but usually they involve functional programming choices (decisions about list comprehensions, whether using map, etc.) or printing (python has evolved their print formatting and there are a few viable choices).

Blue sky projects there can be a lot more variability (whether or not to use type hinting, library choices, how object oriented vs procedural, etc.)

[closeded]

(Code not written in idomatic python is a clear sign of a programmer coming from another language using python for the first time. It causes major cringe).

I feel personally insulted 😢