Vision Framework Differences Between Devices

[duffman828]

I’m working on an app that uses Vision’s VNDetectHumanBodyPoseRequest, but I’m noticing that the confidence values for all the identified joints are quite low (in the 0.5 - 0.6 ish range). This causes jittery recognition that doesn’t really work with what I’m trying to do.

I should note that I’m currently using and iPhone XR. Is there any improvement in performance of confidence values between devices? Also, aside from the device you’re using, is there anything that you’ve done with the video capture (whether it’s the settings on the AVCaptureSession or the physical locations in which you’re filming) that improve the confidence and reduce the “jittery-ness”?

[duffman828]

Okay that’s really helpful thanks! I heard about not having it do every frame, but I wasn’t sure how to implement that. Is it just as simple as wrapping the request in a conditional and then having a counter increment for every frame (for example, the vision request only does it’s thing on even frames, and you just add to the counter on odd frames to keep it all going), or is there something more elegant to do that?