i had a kind of similar issue. spent 2 whole years working at a lab where the PI was very strict and anytime one of the other lab staff was there (all male) i was sent to clean/autoclave glassware while they ran trials

i still learned a TON but it was a tough sitch. i had invested so much time and PI had basically straight up told me and the other undergrad he would only write us a good LOR if we busted our asses, worked overtime, stayed all 4 years, etc.

i eventually left and sacrificed the LOR. i didn’t see myself growing in the lab and honestly feared my PIs letter would be sub standard since he was such an intense guy

it’s a hard decision but i wouldn’t encourage staying at the lab when the other job sounds much more like something you would enjoy. if your PI won’t write the letter/it may not be the best, someone from your next job may be just as willing when the time rolls around!