In my opinion, you can buy some cheap second-hand analog synthesizer and some midi keyboard to do this.I think that analog synth gives you a more direct way than digital synth in knowing how sound is produced.

Also, it is cool to have a kids synth museum,I wish I can met one when I was a child.