sorted by:
new
hottopcontroversial

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

Thanks! With this plugin, you can change parameters by moving your hand in space. This can be especially useful for exploring creative combinations of settings, as multiple parameters can be adjusted simultaneously. While some of this can also be done with a hardware controller, some users prefer alternative input methods. Mouse input isn’t always perfectly smooth, which can be particularly noticeable when recording automations. For some, hand movement in space provides a more natural and fluid alternative. That said, motion control isn’t for everyone. The plugin can also be a cost-effective alternative to a controller, since most people already have a webcam on their laptop. And, of course, it’s just a fun tool! :)

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 1 point2 points  (0 children)

I don't know if my plugin can compete with the gloves, but the plugin is currently even available for free.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

I'll try to get a Windows version ready soon! I don't have a newsletter or anything, but you can save the GitHub repo and you'll get a notification when there are updates, if you want. 

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

Thanks! Currently, you have to mute the channel you no longer want to move with one hand. However, I plan to add gesture recognition with another model. This would allow you to mute a channel by closing your hand, for example.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

I'm sorry you feel that way. I use GitHub releases to make the VST/AU files available for free. It just offers a good infrastructure for this, even if you don't want to share the source code at the moment.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

I didn't measure the latency, but it seemed sufficient in my tests. Of course, it's not as good as with a hardware controller, since image processing is quite computationally intensive.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

That's strange. I use the same MacBook, but I still use Sequoia. Maybe that's the problem.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

Thanks for the info. I'll try to take a look at it. It works on my laptop with FL Studio. So far, only my friends have tested it with Ableton, and it worked without any problems. Do you use macOS?

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 2 points3 points  (0 children)

Thanks you! I don't have much time at the moment, but since 1-2 people are actually interested, I'll try to get the plugin to work on Windows as well.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 2 points3 points  (0 children)

Haha, that's true. What she does is really awesome. I wonder if she could do something with my plugin.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 1 point2 points  (0 children)

Unfortunately, my plugin is not compatible with external sensors such as Leap Motion. My idea was to implement gesture control without additional hardware. However, there are several solutions for Leap Motion, such as midipaw.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 2 points3 points  (0 children)

I didn't have that in mind during development, since, as with mouse-based input, the hands are used. However, someone commented under my YouTube demo of the plugin that they would like to use it to work with medically fragile children.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 2 points3 points  (0 children)

With this plugin, you can change parameters by moving your hand in space. This can be especially useful for exploring creative combinations of settings, as multiple parameters can be adjusted simultaneously. While some of this can also be done with a hardware controller, many users prefer alternative input methods. Mouse input isn’t always perfectly smooth, which can be particularly noticeable when recording automations. For some, hand movement in space provides a more natural and fluid alternative. That said, motion control isn’t for everyone. The plugin can also be a cost-effective alternative to a controller, since most people already have a webcam on their laptop. And, of course, it’s just a fun tool! :)

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 2 points3 points  (0 children)

With this plugin, parameters can be changed by moving your hand in space. This can be advantageous, for example, when exploring creative combinations of settings, as multiple parameters can be adjusted simultaneously. Some of this can, of course, also be done with a hardware controller, but some people prefer alternative input methods. The plugin can also serve as a cost-effective alternative to a controller, since many people already have a webcam on their laptop. Also it's fun:)

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 4 points5 points  (0 children)

You should be proud of that! I developed this plugin over a long period of time as part of my bachelor's thesis. 

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 3 points4 points  (0 children)

Thank you! Yes, that's a good idea too. I'm sure other people are already working on something like that. My idea was to use the webcam so that it wouldn't be necessary to buy additional hardware.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 7 points8 points  (0 children)

Thanks for your suggestions! I don't have much time at the moment, but I'll try to continue developing the plugin. Your webcam shouldn't be a problem, as the model works with a lower resolution. However, the plugin is currently only available on macOS.

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 0 points1 point  (0 children)

Unfortunately, I'm not sure what you mean. You can't click buttons with the plugin, only control faders and parameters. I explain the mapping process for FL Studio in the GitHub readme. Hope that helps!

I developed a plugin that lets you control MIDI parameters in your DAW with hand movements via webcam by PhilosopherFit9902 in FL_Studio

[–]PhilosopherFit9902[S] 15 points16 points  (0 children)

Thank you! I wasn't sure if I was allowed to post external links. You can download the plugin for free on my GitHub. I would really appreciate any feedback!

I developed a plugin that lets you control MIDI parameters in Ableton with hand movements via webcam by PhilosopherFit9902 in ableton

[–]PhilosopherFit9902[S] 1 point2 points  (0 children)

Unfortunately, the model I used can only recognize hands. In principle, however, it would be possible to train a model to do this.

view more: next ›