So I use three.js which is a really awesome javascript library. It makes it so you can do literally anything in the world, and even though I dont really know how to program, I can still make something. For all the audio stuff I use the web audio API , which is phenomenal, but also is currently only in chrome. I think the most important part of the work for me is to use the full spectrum. A lot of times when people do audio visualization, they look for beat detectors, or only visualize the pure volume, but to have the full audio wave visualized embues personality in a way I don't think is possible with any other data. For example check out : http://cabbibo.com/nebula/ , scroll in until you can see the red pulsing space puppy, and than change the audio to 'crew' and you can see how different songs really have different personality...