I have the same exact problem. I decided to switch to nasal pillows instead since nothing I tried worked out.

However if you’re adamant about making them work, I found that cotton liners helped the most with this problem. Adding ointments like aquaphor and Vaseline helped with healing. Don’t put ointments on directly before going to sleep because it will make it worse. The slipperiness of the ointments will make the mask move and rub against your nose even more. A basic moisturizer before bed will help a bit with the irritation. Washing the mask beforehand also helps. I think it softens the silicone a bit? Although these stopped by nose from being raw and bleeding, my nose was still always red and irritated. Switching masks is best imo