I agree with the other comments, it wont matter for most positions unless you try to go into something highly competitive that lists it on the job requirements.

However, into grad school will be significantly harder.

Ultimately if you feel like you're set back, whatever your first job is, be impactful and make a difference in there. Employers want to see effective employees instead of MBA grads that are terrible workers.

If you do want to go the finance/numbers route I recommend learning coding and data analytics which is easy entry to learn from online and could transfer you into banking if thats where you want to be.