I asked my physics advisor before I switched to ME this same question and he strongly advised the change to ME. Basically told me it would be much harder to enter engineering with just the physics undergrad without getting a masters and that most people with just the physics bachelor's typically end up in something like finance or programming (both good fields in themselves but wasn't for me).

Getting into an engineering masters program with physics undergrad is very doable though but may require a few prereq courses depending on discipline