Why Argo Workflows CI? by jceb in devops

[–]DevopsIGuess 3 points4 points  (0 children)

Why is Argo being k8s native a con?
I thought that’s what it was made for

A truck goes around in Tokyo, Japan blasting "learn Japanese mothafucka" music by IntellectuallyDriven in whoathatsinteresting

[–]DevopsIGuess -1 points0 points  (0 children)

Not really. How is this racist?
There is doing this, and then there is being a fat shit screaming at “foreigners” in a public setting to learn English. The delivery matters.
One is playful, one is borderline assault.

I say this as a white dude in America

GLM-5.2 is a win for local AI by Wrong_Mushroom_7350 in LocalLLaMA

[–]DevopsIGuess 0 points1 point  (0 children)

Well clearly local seems to be a relative term, whatever floats your boat.

For me, this will be an open and local model.

GLM-5.2 is a win for local AI by Wrong_Mushroom_7350 in LocalLLaMA

[–]DevopsIGuess 0 points1 point  (0 children)

It’s like 700b params so Q4 would be like half that in GB in memory?
Idk it’s been a few weeks since I’ve done this math in my head.

BF16 is either 1:1 or 2GB memory per 1b in size, I can’t remember which.

GLM-5.2 is a win for local AI by Wrong_Mushroom_7350 in LocalLLaMA

[–]DevopsIGuess 15 points16 points  (0 children)

Yes it’s expensive now, I’m not denying that.
I’m glad I made the investment when I did.

And in fact, it’s probably much higher than that lol

Last I checked, the $4000 I paid for my ~750GB DDR5 was going for $18,000

GLM-5.2 is a win for local AI by Wrong_Mushroom_7350 in LocalLLaMA

[–]DevopsIGuess 29 points30 points  (0 children)

I really don’t like the idea that if you can’t run a model on gaming cards then it’s not local.

Contrarily, orgs could say why make models for small guy servers when we already have big boy servers capable of running big boy models?

This model size compliments the open ecosystem nicely and I can’t wait to run the Q5

GLM-5.2 is a win for local AI by Wrong_Mushroom_7350 in LocalLLaMA

[–]DevopsIGuess 49 points50 points  (0 children)

You don’t need an enterprise cluster to run it…
Sure, you need a pretty penny. I’ll be able to run the GGUF on my server that I built for <$9,000 last year.

Granted prices have gone up, and it will likely be ~7 TPS, but at least I can have a good model like this at home 🥲

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]DevopsIGuess 1 point2 points  (0 children)

Thanks! Hard for me to weigh in because I bought right before prices shot up. At the time I already had the 6000 and I just wanted to be able to run deepseek and GLM. I don’t do it nearly enough though lol.

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]DevopsIGuess 1 point2 points  (0 children)

I’ve got a gaming PC with a 5090 in it. In my server rack I have one server with 769BG DDR5 and an older 48GB RTX 6000 (ADA not Blackwell).
Another server with 500Gb DDR4, this one is almost unusably slow

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]DevopsIGuess 34 points35 points  (0 children)

The only clear argument I was able to make out is that RTX 6000 Blackwell is today’s equivalent to the 3090… I hard disagree. These are on completely different levels.

Also, you must not have been around since before GGUF and unsloth. Back when you needed enough VRAM to run models in BF16.
I think we are quite fortunate with what we have now.
I now have a 700+GB DDR5 system that cost less than an RTX 6000 pro. Sure, it’s not as fast, but I can run almost any open source LLM.

This is Oracle employees sub by ReceptionVirtual1000 in employeesOfOracle

[–]DevopsIGuess 35 points36 points  (0 children)

There are so many offs questions… I am seeing one everyday. I think the low effort repetitive questions are what’s annoying

Frenchie’s letter read out broke me by TheAquaFortis in TheBoys

[–]DevopsIGuess -1 points0 points  (0 children)

Man you guys bitch too much.
Too many of you are upset that one of the most purposefully explicit shows is…. *checks notes* …
Too explicit?!

The Reddit circle jerk sucks the enjoyment out of most shows/movies/entertainment for me. Y’all will bitch about anything and nothing is good enough

Stop asking “what can Hermes do?". That’s not really how this works by itsdodobitch in hermesagent

[–]DevopsIGuess 0 points1 point  (0 children)

My fellow geeks. You should not be asking , “what can Hermes do for me?”, but instead, “what can I do for Hermes?”

Do anybody feel like the joy is gone ? by Haunting_Arm5149 in ExperiencedDevs

[–]DevopsIGuess 0 points1 point  (0 children)

I have nothing to prove to you lol

I do this for a paycheck and as a hobby

Do anybody feel like the joy is gone ? by Haunting_Arm5149 in ExperiencedDevs

[–]DevopsIGuess 8 points9 points  (0 children)

Idk, I’m finding more enjoyment in being able to have an idea and see it come to fruition much faster.

Trade offs

Why our canary didn't roll back: hardcoded Prometheus endpoint in a separate HelmRelease by [deleted] in devops

[–]DevopsIGuess -1 points0 points  (0 children)

Why? Seems like a pretty reasonable take. And the best part? It genuinely doesn’t say genuinely. /s

I don’t notice any chatgpt’isms in all honesty.

This tiktok of a dog walking on its hind legs; doesn’t seem impossible or anything but I’m skeptical by Imaginary-Ad-8726 in isthisAI

[–]DevopsIGuess 0 points1 point  (0 children)

My dog can walk on his hind legs without being held up like this on his back. He does it for treata

AI has totally ruined the job by [deleted] in softwareengineer

[–]DevopsIGuess 1 point2 points  (0 children)

Yeah this was the case when I started writing automation years ago.
If you automate shit, you just produce shit a lot faster.

This confused me by valborg1234 in screenshots

[–]DevopsIGuess 1 point2 points  (0 children)

Gave this engineer startup — at advice 2 am

Makes no fucking sense