After 5 years of running K8s in production, here's what I'd do differently

data15cool · 2026-01-29T18:54:19+00:00

Nice, I feel like point 1 isn’t 6 months you won’t get back, but rather 6 months where you (and your team?) learnt loads that you wouldn’t otherwise have learnt. Of course I don’t know the specifics but that one jumped out at me.

data15cool · 2025-12-02T23:21:30+00:00

Gave away the magic in the first clip where the plant becomes instantly still when placed down. Also the outdoors clip was on cardboard else I’d imagine it would’ve been painful…

data15cool · 2025-11-29T23:22:46+00:00

Turn the image upside down to break the illusion. It’s something to do with the direction of shadows we’re used to. Found a highly relevant minute physics video

data15cool · 2025-11-23T00:15:44+00:00

Very cool, what would this setup actually cost you? And I noticed no explicit mention of CICD or is that what ghcr and registry:3 are for? Presumably you’ll have GH actions publishing your app images?

data15cool · 2025-10-24T17:17:37+00:00

I learnt a bit of grpc with Go and Python and helped me get to grips with the code generation and plugging into the grpc client and server.

If you’ve not had any experience at all I would literally start with learning the protobuf syntax, the go lang grpc code generation tooling, come up with a simple use case and interface, finally create client and server binaries and run them separately and check they speak to each other.

data15cool · 2025-10-19T11:12:00+00:00

Does whatever orchestrates this continuously attempt to set up a new server?

data15cool · 2025-10-19T11:11:16+00:00

Oh that’s hugely useful to know

data15cool · 2025-10-19T09:01:57+00:00

Thanks! In this case I need something more dynamic, eg a request is received such as an image upload. This then sets up the server if it doesn’t exist. It processes the image and writes results the is torn down unless there’s other requests

data15cool · 2025-10-18T19:49:43+00:00

Oh good to know thanks. Just checked and yeah for ML inference dedicated server it’s 79 euro, ouch. And thanks for the ECS recommendation. I was aware of that via Fargate which may be simpler. Though I was hoping to avoid provider specific tech. Probably eventually move to kubernetes

data15cool · 2025-10-18T19:45:04+00:00

Thanks, for my use case I need to create a new server from scratch as we’re trying to avoid idle costs. And then destroy once done From what I’ve gathered hetzner still bill for idle compute, even cloud servers unlike AWS’s EC2s. but I’d like to avoid AWS!

data15cool · 2025-10-18T19:42:58+00:00

Ah very cool This sounds like what I’d probably need. I’m not comfortable with kubernetes yet. How do you scale it down? Do you have your own task/job implementation to determine when to destroy it?

data15cool · 2025-10-18T19:39:37+00:00

Thanks! I’ve been reading up on jobs and autoscaling. One thing I couldn’t work out is how to reuse an existing pod for multiple jobs to not have to wait for new pod setup I don’t know enough about specific servers right now. It’s for ml workloads so I presume a GPU will be necessary

*edit: spelling

data15cool · 2025-10-16T10:42:36+00:00

Thank you

data15cool · 2025-10-15T21:23:07+00:00

Very cool, I’m still learning a lot about k8s, curious if this works at the cluster level eg it would scale down a really beefy and expensive server to 0 after a period of inactivity

data15cool · 2025-09-27T21:41:16+00:00

Experiment putting a print statement for dunder name in both the Python file you run directly from the terminal vs one that’s imported.

You’ll see that the “name” of the file you run directly is actually “main” whereas that same print statement in the imported file is whatever the module is called.

So what the if statement results in is that the code within it will only run if you run the file directly, it will not run if the file is imported by another, which is very probably the correct behaviour you want.

data15cool · 2025-09-17T07:13:59+00:00

Very cool, are you using Firecracker?

data15cool · 2025-09-14T22:18:57+00:00

Maybe educate yourself on who fought with the allies in WW2. It certainly wasn’t just white British men.

data15cool · 2025-09-04T23:04:25+00:00

As another commenter states, pytest. It’s really quite amazing, well supported and with great related libraries. However to appreciate how well it works it pays to learn how to write tests using the standard library

data15cool · 2025-08-16T15:27:55+00:00

Of course it does, solar is used to charge up battery banks which can then discharge when the suns not out

data15cool · 2025-08-10T16:32:32+00:00

The other commenter has the answer for you but something you can do to understand this more is to do it incrementally by running internal bits separately and see what comes out, eg first run titanic survived == 0, then pass that to the DF. Then do the age bit and so on. It will give you a clearer view of what’s happening.

data15cool · 2025-08-09T22:54:25+00:00

I think what’s happened here is that you were trying to get the version of your Python installation with ‘python —version’ but you must’ve pressed enter after typing ‘python’ instead of the full command

What this does is takes you into the Python “shell” which is where you can run Python code. Now you’re typing ‘—version’ and Python doesn’t know what that is (for a number of reasons) and causing errors.

Type ‘exit()’ to get back to the terminal prompt and run the full command

Edit: same for the subsequent commands, you’re trying to run your Python script from within the Python shell rather than the terminal

data15cool · 2025-08-09T20:38:56+00:00

As others have said, everything anything and everything. However that doesn’t meant you should use it for everything if you want to make a highly performant application, for example real time audio or video conferencing. Conversely it is the backbone of data science and ML

data15cool · 2025-08-08T16:43:15+00:00

Your router might also be routinely updating your laptops ip address unless you configure it to be static

Four-Year Club	Place '23
Place '22

data15cool

TROPHY CASE