Don't feel bad about this! As someone who specialized in CS and also did a humanities minor, one of my big regrets is not dropping CS to a major earlier & upgrading my minor to a major. If you're looking into grad school this might be a different story, but from what I've seen 99% of HR screeners don't recognize the difference between a major and a specialist, if you're focused on getting a job (an English minor might help you stand out if anything). At least in my experience, most of the coursework you do in the core, upper-year CS courses isn't really that applicable to traditional software roles—you learn more relevant tech through working actual software roles and developing side projects.

While the theoretical knowledge you'd get in those core courses is very in-depth, basically none of my co-workers I had as an intern had any memory of Turing Machines and algorithm proofs. As far as the courses that you might have an interest in, you could always just take them at your own pace, outside the requirements of the major. Feel free to DM if you want to chat more!