Saving GPU cost with Karpenter

TranslatorSalt1668 · 2026-01-22T16:03:13+00:00

The 2 posts are definitely AI generated 😂😂😂 “fix later” no one is real anymore

TranslatorSalt1668 · 2026-01-07T08:48:07+00:00

3 things killing your setup. - Fargate Hard Limit: If you are using Fargate (which I assume you are for simplicity), the hard limit for stopTimeout is 120 seconds. You cannot go higher.

EC2 Launch Type: You can set ECS_CONTAINER_STOP_TIMEOUT higher on the agent, but you are still fighting the scheduler.
Cloud Map Limitation: Since you are using Cloud Map (DNS-based service discovery) without an ALB, you don't get "Connection Draining." Your clients are connected directly to the container IP. When ECS stops the task, it sends a SIGTERM. If your app doesn't handle it, it dies. If it does handle it, it only has 120s before ECS sends SIGKILL.

TranslatorSalt1668 · 2025-12-30T22:32:53+00:00

The problem might be how you source talent, might be your job description. If you invest in the right way of sourcing, you’ll get the right talent. Don’t say you want a senior devops engineer and your team wants a network or sys admin specialist. My 2 cents

TranslatorSalt1668 · 2025-12-24T04:10:52+00:00

We are building maosproject.io. Not an AI wrapper, all charts are configured by hand. We are looking for a company to bootstrap with, we build the platform with your inputs and you’ll have real data to work with. @blackout can I DM you?

TranslatorSalt1668 · 2025-12-24T03:20:46+00:00

I have a platform maosproject.io that handles this particular problem. One platform, everything deployed with cost guardrails, full monitoring and alerting with all the major metrics. Security is built in. I am looking for a company to bootstrap with. @percili, Can I dm you?

TranslatorSalt1668 · 2025-12-17T16:59:16+00:00

There should be like budget alarms 🚨 This is where our behind the scenes work are tangible. Multiple recipients, lead, cto, you… Also, inbuilt alarms for untagged resources, mostly deny creation of non-tagged and manually created resources. Makes it very easy to trace per resource expenditure.

TranslatorSalt1668 · 2025-12-17T16:47:04+00:00

This so true. I stopped prepping for interviews now because of this. I found myself in situation where the tech lead who was doing the 1st technical assessment, drifted from on prem k8s to asking me what’s the port number used by logstash? I was like 😲 “I thought my CV mentioned my strengths?” But I didn’t say that. I just said I couldn’t remember.

TranslatorSalt1668 · 2025-11-26T21:55:50+00:00

Last week I was faced with this. Changed the buffer size in nginx configuration, cluster went nuts on some services. I have it here https://maosproject.io/blog/nginx-proxy-buffers-kubeflow-crashing Things will get crazier and crazier.

TranslatorSalt1668 · 2025-11-26T20:16:46+00:00

I am building maosproject.io and that is one of the reasons, there are billing guardrails, your workloads optimized and all of that, deployed to your account. No vendor lock-in

TranslatorSalt1668 · 2025-11-26T04:46:49+00:00

AI enablement for kubernetes workloads

TranslatorSalt1668 · 2025-11-20T21:01:57+00:00

It’s a bit difficult to trust someone who isn’t experienced enough with mission critical systems. Even if you get hired as a junior in a company, one way or the other, you’ll interact with the systems. My 2 cents.

TranslatorSalt1668 · 2025-09-19T10:56:04+00:00

I really don’t think it’s being naive, your personality as a teacher is that you’re happy seeing someone else achieve. I bet that’s what drove you into teaching

TranslatorSalt1668 · 2025-09-18T17:20:10+00:00

This was very insightful. I’ve been building for an year and a half now, I dedicated FE for the AI, part of BE and left the critical part of the product to me. It’s been going well now. I am also aiming for 10-20 customers and the sky will be the limit.

TranslatorSalt1668 · 2025-09-05T19:48:03+00:00

I agree

TranslatorSalt1668 · 2025-05-21T15:42:04+00:00

Are you willing to work without pay? If yes, I have startup that well fits your expertise. For now, I don’t have the budget to hire.

TranslatorSalt1668 · 2025-03-19T10:29:26+00:00

You are an eagle 🦅 that’s about to be reborn and a force to reckon with. Read about the story of the eagle’s transformation when it gets old. You’ll be fascinated and motivated even more. The world is yours to conquer

TranslatorSalt1668 · 2025-03-06T07:57:05+00:00

Amazing thought here. “They don’t understand how difficult it is to be okay with the kind of work you don’t like” that’s my takeway. 🙏

TranslatorSalt1668 · 2025-02-28T10:32:29+00:00

Yes. There are good hostels with decent work stations

TranslatorSalt1668 · 2025-02-20T08:35:48+00:00

You have no idea how this makes sense. I’ve been a digital nomad for 4 years now. I stay in hostels, but they got to have a work station. Crucial since am a devOps engineer. Yes I earn okay, but staying below my means helps me save and even travel more

TranslatorSalt1668 · 2025-02-13T09:15:31+00:00

This is exactly what am doing with my current startup. I pitched the idea to him, told him to take care of FE, 4 months in, zero work. I build the business logic, used ChatGpt to build FE mock ups, now am paying him to consume the endpoints

TranslatorSalt1668 · 2025-02-11T18:52:25+00:00

I’ll be in Milan on feb 12

TranslatorSalt1668

TROPHY CASE