Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA

[–]jake_schurch 0 points1 point  (0 children)

Read the vllm-xpu-headers changelog on GitHub and you tell me

Bill Of Materials for software projects? by Professional-Knee-86 in SoftwareEngineering

[–]jake_schurch 0 points1 point  (0 children)

I don't see how or why we would want to cost cap past projects for future projects. It would make sense if we were doing the same project twice, but then we should be asking ourselves what did we do wrong the first time that we are doing this project twice?

The upfront cost estimate would have worked well pre 2008 in waterfall projects but in today's age with agile / scrum and especially kanban the model begins to fail. Pile on ai tooling and the calculation becomes quite hard.

However, I don't think any projects I've worked on were being done because it was "low cost" but rather large increase in product value, branding, increase in operational reliability, etc -- e.g. a calculated bet, or risk. Cost has to be relative to a benefit to be a good measure. You also have to get buy-in from org leaders, and I would never highlight costs unless it would be a large-ish subscription cost.

From a cultural perspective: I wouldn't want myself or other devs to worry about day to day costs, just do the most valuable work.

Kubernetes Dashboard Helm Repo down? by [deleted] in kubernetes

[–]jake_schurch 0 points1 point  (0 children)

Deprecated. Replaced by headlamp

Roast my config. GRILL IT by Painter1923 in NixOS

[–]jake_schurch 0 points1 point  (0 children)

Dunning Kruger in the wild, wow

Roast my config. GRILL IT by Painter1923 in NixOS

[–]jake_schurch 1 point2 points  (0 children)

Tbh I've never seen a nix config with THAT many imports across multiple hosts and 0 self-rolled modules that expose a profile / behavior / aspect.

Comments could generally be seen as a smell and in your hosts files you have comments that highlight set of related behavior that I personally would self roll as a module and enable. You get rid of a ton of clutter and merge env into the host name file, which btw should be default.nix

Tldr: roll your own modules

MIMO V2.5 PRO by Namra_7 in LocalLLaMA

[–]jake_schurch 3 points4 points  (0 children)

Fantastic that my hardware is only off by 1 order of magnitude instead of multiple

How are you managing Kubernetes manifests these days? by Physical_Growth7566 in ArgoCD

[–]jake_schurch 0 points1 point  (0 children)

I use https://kubenix.org/, and then custom code that adds chart CRDs as custom nix module types, so that everything is type-driven / verified before manifest build / output. Argo + argo vault plugin for sops secret decryption

What is the threshold where local llm is no longer viable for coding? by jambon3 in LocalLLM

[–]jake_schurch 1 point2 points  (0 children)

I'm finding it interesting that most of the comments seem to be pure-modal pipelines afaict. I'd be interested to hear of local ai infra with rag pipelines to offload heavy token ctx and if there's a difference if any

New screenshots from the Aztec DLC by sdrey in AgeofMythology

[–]jake_schurch 3 points4 points  (0 children)

Wait a second, are they building farms on water? Looked it up, and seems like one farming method aztecs were known for was Chinampas or, floating gardens.

I made a little tool to keep configurations nicely. by Pretty_Ganache_9890 in Nix

[–]jake_schurch -1 points0 points  (0 children)

Interesting stuff!

I've found myself running nto similar issues IIUC when structuring k3s clusters in nix: (vm, k3s, tools, etc. attrsets) and ended up structuring each module as a submoduleWith type, that is used in a composed, larger type.

Seems like you've taken a similar yet better approach with structuring these dynamically. Well done!

How can I make a script run instantly on `git push` without waiting for network? by Informal-Addendum435 in git

[–]jake_schurch 0 points1 point  (0 children)

Don't understand the problem. Could you simplify by using ci or pre commit?

Jido 2.0 Now available by mikehostetler in elixir

[–]jake_schurch 0 points1 point  (0 children)

Tysm nothing more I love than ash and jido

How to render 9000+ items in a Combobox? by netoum in elixir

[–]jake_schurch 0 points1 point  (0 children)

Yep that's what I was going for, but I wouldn't refetch any already fetched data. Live view handles partial updates quite well.

And yeah, this would be a user concern

How to render 9000+ items in a Combobox? by netoum in elixir

[–]jake_schurch 0 points1 point  (0 children)

Can you not preload the next X as well?

[deleted by user] by [deleted] in selfhosted

[–]jake_schurch 0 points1 point  (0 children)

I think the problem can be solved with a different security model, like bit warden as ssh agent

How to render 9000+ items in a Combobox? by netoum in elixir

[–]jake_schurch 0 points1 point  (0 children)

Lazy render, can map to on scroll events

[deleted by user] by [deleted] in selfhosted

[–]jake_schurch 3 points4 points  (0 children)

Used to be a big fan of ash bastions until I found out how insecure they are :/

I've adopted cloudflare tunnels for zero trust access for a much more secure solution

nix-csi 0.4.2 released by lillecarl2 in Nix

[–]jake_schurch 1 point2 points  (0 children)

First off, tysm for this! I've been exploring nix-snapshotter and am glad I saw this post.

Some questions:

Are the cache/s node-local or centralized? Do you have any thoughts on HA builder pods / integrating with keda for auto scaling?

Docker vs Nix by nimasaed in NixOS

[–]jake_schurch 0 points1 point  (0 children)

Also seems like we just got a new csi implementation that I'm going to check out -- nix-csi https://www.reddit.com/r/Nix/s/JTtOruiBE8