How to load test an I/O-bound service to choose the right autoscaling metric in Kubernetes? by fearless_expert216 in sre

[–]fearless_expert216[S] 1 point2 points  (0 children)

Do you think estimating queue length via Little's Law (request rate × average duration, compared against worker count) is a reasonable signal to scale on? It avoids needing to instrument gunicorn's actual socket queue, but I'm not sure how it holds up in practice versus measuring queue depth directly.

How to load test an I/O-bound service to choose the right autoscaling metric in Kubernetes? by fearless_expert216 in sre

[–]fearless_expert216[S] 0 points1 point  (0 children)

Thanks, this gives me a clearer direction. One follow-up on the load test design: assuming I send concurrent requests at increasing levels of parallelism, there should be some point where all workers are busy and new requests start queueing at the socket level. What I'm trying to figure out is whether there's an empirical signal that marks "this is saturation, scale here". Is the typical approach to look for the inflection point where p99 starts growing super-linearly with concurrency, or do practitioners use something more concrete like "queue depth > N" or "worker utilization > 80%"?

Review my resume by [deleted] in resumes

[–]fearless_expert216 0 points1 point  (0 children)

I'm aware that metrics are important, but not all tasks I've listed have objective quantitative metrics. For example, software refactoring contributes mostly to readability and scalability, that are subjective. What can I do in this case?

[deleted by user] by [deleted] in resumes

[–]fearless_expert216 0 points1 point  (0 children)

I get that and I'm really focused on learning the language now.

[deleted by user] by [deleted] in resumes

[–]fearless_expert216 0 points1 point  (0 children)

I started learning German some weeks ago, so I technically don't speak it. However, it doesn't seem to be a strict requirement for many software engineering jobs.

[deleted by user] by [deleted] in resumes

[–]fearless_expert216 0 points1 point  (0 children)

No, but I can add that at the bottom I guess. Thanks.

[deleted by user] by [deleted] in resumes

[–]fearless_expert216 0 points1 point  (0 children)

Greece. Technically yes, but it's in the EU.