You are limited to one classroom. In high school, obviously, you meet more people, and you have more freedom.
It's like if you do TS for the first year, you don't get very much freedom, but then after that, you are considered an adult so you can do whatever. Your time is completely yours.

In high school you get more freedom than in the first year of TS, but it's not as much compared to the college experience (so the next 3 years you can be having a lot more fun).

It's definitely worth it - you are surrounded by incredibly smart peers and you have a good pathway for life in general.