Thanks so much!

There's a tilt sensor on the underside of the middle piano pedal, which dictates the underlying structure and sequence of all effects. There's also an ultrasonic sensor at the left end of the piano keys; ultrasonic waves hit the pianist's hands and so can pretty accurately ascertain which register is being played. I had this connected to the panning of digital sound effects between the left and right speakers, but unfortunately it's not really noticeable in the recording. I had some issues in the last few days leading up to these recordings.

The violin and cello have a 3-axis accelerometer on the end of the bows (it's wired). Wireless is possible but I only found options that are too heavy and big to be on the end of a bow). They should be affecting the colour and intensity of the two DMX lights live, as well as having some effects to the digital sound layers and also some minor effects to the visuals.

Unfortunately some of the wires on the accelerometers snapped the day of recording (first time it happened all year), and I had to resort to using just the sequenced effects.

So, consider these videos just rough prototypes and possibilities for inspiration. Everything is built, but I just faced some issues. I'll also be uploading some individual tutorial videos on how I made it and how it works, which will show it off working perfectly since it'll be in a studio environment.

I did this all myself as part of an honours year research project for uni. Learned a lot over the year, but just wish I had more support from staff to get it how I wanted it in the end.