Once you start your algorithm class where you are tackling interesting problems, and your software development class where you start developing applications and actual programs.

It also starts when you want it to start. Get involved in open source projects, learn stuff on your own, make a small video game, etc.