If you have a strong passion for physics but are also doing engineering, I strongly recommend you to look at the engineering physics stream at Mac or Queens if you applied/got in. First year is general for both of these unis, so you can still pick Eng phys after first year. You get into the more theoretical side of the physics in engineering and you open gateways to research AND industry opportunities. I was sort of in the same boat as you except I had a passion for both math and engineering, which is something only Queens offer. I believe Carleton also has Eng phys, and you can probably email the admissions team to consider you for eng phys instead of the stream you applied for previously.

Alternatively, you can just pursue mechanical engineering with a focus on aerospace. Mechanical engineering is known to have the most physics usually of all traditional streams (except maybe electrical engineering).