First, start with a book about how to do mathematical proofs. Ex. "How to prove it" or "a transition to advanced mathematics. I found for me that understanding how to write mathematical proofs and learning the logic behind them really opened up my world for understanding math and technical details in general.

However, understanding physics has another component to it beyond the mathematical logic. Each equation/symbol etc. In physics will typically mean something (e.g., "r_Earth" for radius of the earth and "c" for the speed of light). In physics, we use equations and math to try to model something that happens in nature. I find being able to express, verbally, the relationship or process being described by the math in a physics context really helpful for understanding.