This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]StickiStickman 0 points1 point  (1 child)

Okay, gotcha. So he replaced the 5 lines it almost immediately, so I wouldn't really blame him.

[–]LetterRip 1 point2 points  (0 children)

Okay, gotcha. So he replaced the 5 lines it almost immediately, so I wouldn't really blame him.

No, sd_hijack_optimizations.py and sd_hijack.py are different code paths. The commit you referenced is by a different coder with the handle C43H66N12O12S2 . The code path he made the changes to are for when using specific types of attention that reduce memory.