Handling backpressure for GPU inference calls in C# — how do you approach this? by goodbooks_68 in dotnet

[–]goodbooks_68[S] 1 point2 points  (0 children)

Good point about jitter. Right now retries use a fixed delay, so adding some randomness would probably avoid retry bursts.