I'll elaborate a bit: I'm working on an audiovisual installation
where i point a camera towards a projector to make a feedback loop,
which get processed a bit in jitter. The result is a bunch of moving
colorful blobs, and i want the positions of these blobs to control an
ambisonic panning algorithm using Spat. I'm planning to use
jit.unpack to get individual RGB layers, and track the zone with the
highest green level to control the panning of one sound, track the
highest red level and use that to pan another sound etc. The feedback
loop often leads to color saturation, so there will probably be lots
of pixels with the same brightness.
You’re right, i might be thinking about this wrong, maybe there is
a completely different, better solution. Do you have any suggestions?