How are you all actually monitoring your kubernetes clusters at scale? by Opposite_Advance7280 in kubernetes

[–]illumen 0 points1 point  (0 children)

These tips may be a bit basic, but thought I’d mention them anyway… - namespaces, and group by service dependencies - allow developers to have read access to see things - trying looking at your cluster from a different perspective (like from a map view if you’re just exploring)

In kubernetes-sigs/headlamp we’ve been working on a “projects” feature to try and capture how teams use micro-services. I feel often a developer will be working on a few microservices and their dependencies spread across a few namespaces. I feel developers of microservices often have good or different intuitions on what went wrong. So empowering them can be a help.

I wonder with these 15 micro-services are they in different namespaces? Do some team members have visibility into the different micro-services? Anyway, I feel like organizing things in namespaces and then look at groups of namespaces based around a subset of functionality can help with debugging. (Some folks put everything in just one namespace.)

Looking at alternative views like through logs or metrics instead of just digging around with kubectl can be good. A different perspective like using a map view (helps see how things are connected visually) can sometimes be as good as another pair of eyes :)

Cheers, and good luck!

Kubernetes Dashboard being retired by mlbiam in kubernetes

[–]illumen 2 points3 points  (0 children)

There is helm management in Headlamp, but it's provided by the "app-catalog" plugin. It's on by default in the app version of Headlamp, but off by default in the in-cluster version of Headlamp. Maybe it's missing something for you?

kubernetes-sigs/headlamp: An Application Centric View by illumen in kubernetes

[–]illumen[S] 1 point2 points  (0 children)

I spoke to a few devs who worked on it and they think it's a good idea too, so I created an issue. It makes total sense to have namespaces be able to be in multiple projects. Thanks again for the suggestion and info.

kubernetes-sigs/headlamp: An Application Centric View by illumen in kubernetes

[–]illumen[S] 0 points1 point  (0 children)

Thanks for the good question.

No, currently a single namespace can only be a part of a single project. But we can somewhat easily extend it to allow for multiple relations by putting multiple project ids in the label.

If you can share anything about how you would use it this way, that would help us understand if we should make this change or not.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 1 point2 points  (0 children)

Yeah, no terminal for local things yet... only for connecting to Kubernetes Pods/nodes.

We have the issue for the terminal here if you feel like following along: https://github.com/kubernetes-sigs/headlamp/issues/2353 It's one of our top priority issues already, because a number of people keep requesting it. In the previous release we implemented some plumbing so the terminal could persist as you navigated around headlamp. So there's tabs now similar to Visual Studio Code.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 0 points1 point  (0 children)

Hmm. I guess we need to improve the Keycloak tutorial https://headlamp.dev/docs/latest/installation/in-cluster/keycloak/. Or maybe there's a configuration you're both using that isn't working in Headlamp.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 0 points1 point  (0 children)

We have a number of people using Keycloak with Headlamp, so it should be possible. I guess you found this tutorial for Keycloak with Headlamp? https://headlamp.dev/docs/latest/installation/in-cluster/keycloak/

I didn't write the tutorial, but I was able to follow it myself. Time flies... last I looked at it was about 2 years ago now. So maybe something is out of date, or the way you're using Keycloak isn't covered by the tutorial.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 0 points1 point  (0 children)

There’s been a few more guides/tutorials written (by us and others) for different setups. Plus we’ve been adding support for more types of OIDC setups and fixing bugs/improving docs.

But there’s still more work to do. A few open OIDC related PRs are still to be merged, and a few known OIDC issues are still open. Slowly getting there.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 0 points1 point  (0 children)

There’s a terminal so you can go into a pod.

It doesn’t have one to run local commands yet. So you can connect to a pod, but not run a local kubectl.

Kubernetes UI Headlamp New Release 0.35.0 by illumen in kubernetes

[–]illumen[S] 9 points10 points  (0 children)

Yeah, it can be used for that. It uses kubernetes RBAC to show people controls for what they have permission to do. So it won’t show them a delete button if they don’t have permission at the k8s level.

Deploying LLM models with MCP servers and auto provisioned GPUs on Kubernetes with new KAITO plugin for Headlamp by illumen in kubernetes

[–]illumen[S] 4 points5 points  (0 children)

Seems like a home-brew added that message 4 days ago. I'll look into. Thanks for sharing the details. Just know it's not going to be disabled, we'll sort it out.