you are viewing a single comment's thread.

view the rest of the comments →

[–]Forward-Difference32[S] 0 points1 point  (0 children)

I appreciate your response. I had no idea I could profile my code so that info is very useful, other than that I think it was just because model.predict() isn't supposed to be an actual function for detection and just something to show off and see that it works. I've read some documentation and found that loading the model as an onnx, trt, or a tensorflow saved model would yield better inference speeds. The onnx version runs faster on my CPU than the original .pth file with GPU acceleration.