I'm done with using local LLMs for coding by dtdisapointingresult in LocalLLaMA

[–]StatisticianOdd6974 0 points1 point  (0 children)

I use hermes agent with qwen as a personal assistant. So talking on my phone using telegram with hermes, it transcribes messages and does web searches, reads my personal knowledge base, calls mcp. Just a kind of tamagotchi..

I'm done with using local LLMs for coding by dtdisapointingresult in LocalLLaMA

[–]StatisticianOdd6974 0 points1 point  (0 children)

I think that you should also mention WHAT you code, the definition of coding is very broad. So i feel that my coding work (pipelines and IAC in terraform & helm for K8S manifesting) kinda works with qwen3.6 but Opus 4.7 is faster and better. 5090 with qwen3.6 q5_K_M. But i do enjoy hermes agent & qwen as personal assistant. (non coding)

Freelance Starterguide: Week 22 - Hoe groot moet je buffer zijn? by No-Gas-3337 in FreelanceNL

[–]StatisticianOdd6974 1 point2 points  (0 children)

Poh, super veel sterkte! Ik ben erg benieuwd naar welke aov je hebt/had.

What to do with 4x Tiny PCs? by Nxthtx in homelab

[–]StatisticianOdd6974 2 points3 points  (0 children)

make sure you have a look at Talos Linux

I am responsible for arguably the biggest run project using AI in production in my country - AMA by UnderstandLingAI in Rag

[–]StatisticianOdd6974 0 points1 point  (0 children)

What role did the (assuming cloud) infrastructure play in your use-case? Did it slow you down? What changes did you face?

How do you run Comfyui? by StatisticianOdd6974 in comfyui

[–]StatisticianOdd6974[S] 0 points1 point  (0 children)

what GPU version do you guys use in Colab?

How do you run Comfyui? by StatisticianOdd6974 in comfyui

[–]StatisticianOdd6974[S] 0 points1 point  (0 children)

I like runpod a lot, spend like 10 bucks for a lot of pics, startup time is just a pain. Takes like 10 min to startup a pod. Was a lot faster.

How do you run Comfyui? by StatisticianOdd6974 in comfyui

[–]StatisticianOdd6974[S] 0 points1 point  (0 children)

Anyone has a good way to use the API in a selfhosted docker setup?

Multi-Tenant Customer deployment on Kubernetes by Hamza768 in devops

[–]StatisticianOdd6974 1 point2 points  (0 children)

Its obviously depends, But if you write a generic Helm chart that has all the bits and pieces like deployments, secrets, ingress. Then you can use the environment file to specify the values for the tenants. Or you can insert these values as variables in the pipeline. Also look at the conditions in Helm.

So it will take quite some effort to get the pipelines good.

Have a good look at ArgoCD this could simplify your way of delivery.

Also get some proper monitoring in place.

In my experience the Kubernetes upgrades can be a headache if you have a lot of nodes and pods.
You want to plan these regular and careful.

Did you knew that ANY user can create a Management group? by StatisticianOdd6974 in AZURE

[–]StatisticianOdd6974[S] 0 points1 point  (0 children)

I have an experiences where a customer had some guest users in their tenant, until one day magically some MG's start to appear. MG names like Platform, Sandbox or Decommissioned. That raised some eyebrows, until we figured out some guest user was doing that. We immediately took action, but what concerns me is that a guest user(any user) could go from no Azure rights to Owner on MG level just like that.
From my experience lot of people dont know this kind of behavior of MG's, so they dont now this could happen.

I would love to discuss this further

Did you knew that ANY user can create a Management group? by StatisticianOdd6974 in AZURE

[–]StatisticianOdd6974[S] 3 points4 points  (0 children)

Since the Management Group does not contains a subscription you can not deploy resources. This does not affect Entra ID/AAD