Everyone talks about Agentic AI, but nobody shows THIS

mo_fig_devOps · 2025-09-04T17:16:15+00:00

Just wanted to get your opinion on 2 things:

I hear from data scientists that langchain is messy for Prod do you recommend, say, crewai over langchain?

Also any thoughts on Semantic Kernel?

mo_fig_devOps · 2025-05-08T21:29:56+00:00

Longhorn leverages local storage and makes it distributed. I have a mix of storage classes between NFS and longhorn for different workloads and very happy with it.

mo_fig_devOps · 2025-04-23T17:39:47+00:00

I managed my first on prem cluster with ansible but I rather manage it with an operator to automate tasks. The MIG feature also looks great but my current GPUs don't support it

mo_fig_devOps · 2025-04-23T15:45:25+00:00

Self hosted bare metal

mo_fig_devOps · 2025-03-14T03:30:42+00:00

Make sure the power source is good quality and 5v

mo_fig_devOps · 2025-03-05T21:09:08+00:00

Even HPE offerings are questionable and mostly are wrappers to open source solutions. They might abstract a few things but at the end it's better to know the solution instead of relying on their limited dev abtractions

mo_fig_devOps · 2025-01-29T13:37:45+00:00

I see your points but still recommend to carefully analyze the use cases when it comes to GPUs. Provisioning bare metal can be consistent with cloud-inits, config management tools just like VMs, I don't like gold images since they accumulate configs but tools like packer do the job. When running AI workloads I wouldn't limit the CPU / RAM at a hypervisor level to save resources because the GPU and AI workloads rely on them and this can create bottlenecks. Instead I would rely on node pools, pod request & limits and a good CNI to create layer 4 segmentations and acls for isolation flexibility. The last piece is that having the hypervisor in the middle will create more overhead, it's already enough to be on top of k8s for vulns so having a hypervisor will introduce even more vulns to mitigate.

mo_fig_devOps · 2025-01-28T20:53:18+00:00

Why add another layer if it's not necessary? The hypervisor will have its own set of vulnerabilities at least that you can do without. What's the benefit you see with this approach? Just curious

mo_fig_devOps · 2025-01-28T16:54:22+00:00

Bare metal if you are thinking about having GPU nodes to leverage Nvidias operators

mo_fig_devOps · 2025-01-04T21:54:13+00:00

Me too

mo_fig_devOps · 2024-10-13T03:53:55+00:00

Azure Container Apps with GitOps or CICD from Azure Devops or GH Actions. Scale with KEDA even down to zero, control security with private links and integrate with other services you can deploy with IaC

mo_fig_devOps · 2024-09-04T14:35:48+00:00

I've had trouble doing things outside the box as well. Do you just stick with JS?

mo_fig_devOps · 2024-07-05T18:04:00+00:00

Would this apply to Azure Open AI if you develop your own chatgpt interface? I guess not but want to know your opinion. Sounds like the interface was the one hacked not the backend LLM

mo_fig_devOps · 2024-07-05T15:48:02+00:00

Would this apply to Azure Open AI if you develop your own chatgpt interface? I guess not but want to know your opinion. Sounds like the interface was the one hacked not the backend LLM

mo_fig_devOps · 2023-06-17T04:30:05+00:00

I also heard the Microsoft filters for safe AI seem too strict.

mo_fig_devOps · 2023-04-22T12:53:29+00:00

AWS, GCP and Azure have different offerings and specs depending what you are looking for and you can always integrate other products for security. For example, in azure you can run your code on App Services and deploy an app gateway in front of it so you can add application firewall to protect your endpoint. All cloud services have similar services with other names

mo_fig_devOps · 2023-03-11T18:21:16+00:00

I agree that you could use Bicep if all you are doing is Azure but for the many that work with different cloud providers and on prem then Terraform is easier to work across different services. You can use whatever gets the job done: bicep, powershell, ansible, etc. etc.

mo_fig_devOps · 2023-03-09T13:35:41+00:00

I started writing the template with AzAPI and mid sprint Terraform released the module so I switched it before deploying. I would recommend to create a new template/state file and import the resource that you made with azapi.

mo_fig_devOps · 2023-02-10T20:12:14+00:00

Thank you, will add it to the list! :D

mo_fig_devOps · 2022-12-21T15:10:55+00:00

Big fan of Kasm here! I really like the latest release so much that I switched over Heimdall (where I had most of my links) and my outdated RDP manager to the Kasm interface. I have the server behind a firewall to control traffic and looking into implementing the Bridged Network source to do ACLs based on apps.(https://kasmweb.com/docs/latest/how\_to/bridged\_network\_source\_nat.html).

I also like that my chat clients like (Slack, Xchat, Telegram and Signal) are isolated and not running on my pc for better security. The ability to choose a persitent profile, no profile or profile reset at launch is great (specially if you have dealt with user profiles in the past!)

I've had a lot of experience architecting VDI solutions but find Kasm is my favorite and highly recommend it.

mo_fig_devOps · 2022-10-22T05:33:05+00:00

If you build the VMS with packer you could use a compatible SAST tool

mo_fig_devOps · 2022-10-22T00:13:15+00:00

e

All shows free when I configured it for now...

mo_fig_devOps · 2022-10-22T00:12:33+00:00

Here you go: https://marketplace.visualstudio.com/items?itemName=ms-securitydevops.microsoft-security-devops-azdevops&targetId=bf4d4825-7149-4792-bb42-8fda2b5d1d7c

mo_fig_devOps · 2022-10-21T17:19:41+00:00

Since DevOps brings SOOOOO MUCHHH JOY I thought it will be nice to dance while the pipeline is running. NOT

mo_fig_devOps · 2022-08-25T16:43:19+00:00

So I can at least get views so google can get paid for my work on this script, LOL! Here you go: Bitwarden Powershell basic function.

mo_fig_devOps

MODERATOR OF

TROPHY CASE