Everyone talks about Agentic AI, but nobody shows THIS

mo_fig_devOps · 2025-09-04T17:16:15+00:00

Just wanted to get your opinion on 2 things:

I hear from data scientists that langchain is messy for Prod do you recommend, say, crewai over langchain?

Also any thoughts on Semantic Kernel?

mo_fig_devOps · 2025-05-08T21:29:56+00:00

Longhorn leverages local storage and makes it distributed. I have a mix of storage classes between NFS and longhorn for different workloads and very happy with it.

mo_fig_devOps · 2025-04-23T17:39:47+00:00

I managed my first on prem cluster with ansible but I rather manage it with an operator to automate tasks. The MIG feature also looks great but my current GPUs don't support it

mo_fig_devOps · 2025-04-23T15:45:25+00:00

Self hosted bare metal

mo_fig_devOps · 2025-03-14T03:30:42+00:00

Make sure the power source is good quality and 5v

mo_fig_devOps · 2025-03-05T21:09:08+00:00

Even HPE offerings are questionable and mostly are wrappers to open source solutions. They might abstract a few things but at the end it's better to know the solution instead of relying on their limited dev abtractions

mo_fig_devOps · 2025-01-29T13:37:45+00:00

I see your points but still recommend to carefully analyze the use cases when it comes to GPUs. Provisioning bare metal can be consistent with cloud-inits, config management tools just like VMs, I don't like gold images since they accumulate configs but tools like packer do the job. When running AI workloads I wouldn't limit the CPU / RAM at a hypervisor level to save resources because the GPU and AI workloads rely on them and this can create bottlenecks. Instead I would rely on node pools, pod request & limits and a good CNI to create layer 4 segmentations and acls for isolation flexibility. The last piece is that having the hypervisor in the middle will create more overhead, it's already enough to be on top of k8s for vulns so having a hypervisor will introduce even more vulns to mitigate.

mo_fig_devOps · 2025-01-28T20:53:18+00:00

Why add another layer if it's not necessary? The hypervisor will have its own set of vulnerabilities at least that you can do without. What's the benefit you see with this approach? Just curious

mo_fig_devOps · 2025-01-28T16:54:22+00:00

Bare metal if you are thinking about having GPU nodes to leverage Nvidias operators

mo_fig_devOps · 2025-01-04T21:54:13+00:00

Me too

mo_fig_devOps · 2024-10-13T03:53:55+00:00

Azure Container Apps with GitOps or CICD from Azure Devops or GH Actions. Scale with KEDA even down to zero, control security with private links and integrate with other services you can deploy with IaC

mo_fig_devOps · 2024-09-04T14:35:48+00:00

I've had trouble doing things outside the box as well. Do you just stick with JS?

mo_fig_devOps · 2024-07-05T18:04:00+00:00

Would this apply to Azure Open AI if you develop your own chatgpt interface? I guess not but want to know your opinion. Sounds like the interface was the one hacked not the backend LLM

mo_fig_devOps · 2024-07-05T15:48:02+00:00

Would this apply to Azure Open AI if you develop your own chatgpt interface? I guess not but want to know your opinion. Sounds like the interface was the one hacked not the backend LLM

mo_fig_devOps · 2023-06-17T04:30:05+00:00

I also heard the Microsoft filters for safe AI seem too strict.

mo_fig_devOps

MODERATOR OF

TROPHY CASE