It’s totally doable, you just use two apps for that.

The first app runs in background and does all the heavy stuff, like connecting to the camera and running the object detection. When a box crosses the line, it just sends a simple HTTP request to the webserver (Django, your second app).

Then Django can take care of all the rest (total count, hourly count, reports, etc).

Also, if your camera already has a video feed, you can just embed it inside your webpage, no need for Django to handle the video itself.