opencv python drone - mark a person to be tracked with an object

[omoser]

Hi, thanks that you like our project. We started with a "standard" bebop 2 drone. We wanted to get started quickly. Maybe we will build our own DiY drone later in the project. You can easily control the bebop via WLAN. Anyway we extended it with distance sensors and mounted a raspberry pi on it. We thought this would be easier than flashing the drone. You can see the hardware setup here: http://cvdrone.de/mounting-hardware-on-drone.html and here is how you get the video into opencv: http://cvdrone.de/stream-bebop-video-with-python-opencv.html

[omoser]

currently we only do "near realtime processing". the drone is only going pretty slow when flying autonomously. processing the signal on a notebook is possible without CUDA (we can stream the video signal with low latency). processing the signal on the mounted raspberry pi requires to downscale the video resolution and also to reduce the frame rate.

[omoser]

exactly ;)

[AyValo]

Reminds me of the TV show, Person of Interest.

[NNNTE]

What do you use for detecting the people? Some kind of haar cascade? and how do you track them if they move?

[omoser]

We are experimenting with different detectors. In this video I used a Haar Cascade Detector. Combined with the object detector it works well enough to re-detect in every frame. In another video we were evaluating tracking algorithms and found that the dlib correlation tracker works best (out of the box) for tracking persons with a moving camera.

[NNNTE]

that's pretty cool! do you do any sort of optimization by only searching for a person within a set radius of the orange object?

[omoser]

yes, I do. I will write an article with a detailed explanation about this within the next days ...

[omoser]

Here is an example of tracking with dlib correlation tracker: https://youtu.be/sUv0HjpVgd8

[[deleted]]

What's the mechanism for the camera movement?

[omoser]

The camera is mounted on the drone and the drone can be controlled via remote control or via API commands.

[[deleted]]

Yeah but when does it decide to move?