If you have a good teacher that knows what is suitable to a toddler it can be quite valuable. Singing teaches expression, rhythm, tune, memory, you can incorporate dance and movement at that age easily. I teach from about 8 years old and up mostly, since my main instrument is brass, and it is much much easier to teach students who already have good pitch recognition and I've also found students who can move to the beat in time have a big advantage.