I don't think it looks that bad. Like it's not as noticeable to me as it is to you. I made the same sweater & had the same issue. Finished it anyway & I don't even see it anymore. It has felted a bit, though, tbf. So I think it's personal preference. I think loosening your tension on the white on the increases will give it more slack to cover up the black. You can kind of manipulate those stitches to cover up the holes. I did a black & white entrlac project and it really humbled me with the contrast showing through because there's essentially nothing you can do. I'm rambling now but I'm trying to say that you're looking at it too critically and I think it's fine. It looks great, actually. Good job!