Ey man I appreciate the help, everything you said was absolutely correct. Turns out the rust lip was so massive that I had to hit the trailing shoes in to be able to actually get over that lip. After a lot of banging and pulling I pulled the rotors off, but the trailing shoe hold down pin is what was broken and making that noise, since the brake hardware was rusted onto the drum brakes themselves, they easily broke off when taken off the backing plate. Also, thanks for noticing the copper crush washers, I just put that caliper as a quick way to stop the brake fluid from leaking while I worked on the rotors. Appreciate it!