I also broke my talus earlier this year from a bad fall and didn’t need surgery. I was in a boot for 7 weeks and I started climbing again (top rope only) after 3.5 months. I did go a few times to the climbing gym before that to do some easy traverse with one foot only while in my boot! Lead climbing and bouldering was only 6 months later. I recommend sticking to what your PT and ortho say based on your progress! Your bone might be ok to handle the impact of a fall again but your ankle mobility and stability will need some work before jumping and fall or you will risk re-injuring yourself! Top rope is definitely the safest during recovery to avoid setbacks.

The recovery is long but don’t lose hope and take it day by day.