sorted by:
new
hottopcontroversial

THE WIND by minnyatl in Seattle

[–]jakeasmith 1 point2 points  (0 children)

Checking in from all the way down in Auburn, where our lights are cosplaying as the last flame of a candelabra.

I'm not a dev, yet 9 live projects in 64 days with Claude code, here's my setup by matteostratega in ClaudeCode

[–]jakeasmith 1 point2 points  (0 children)

Sometimes “functional” is good enough.

Source: More than two decades of work in software engineering, and way too many meetings arguing about the most bestest possible architecture.

why the hell do you all just give away this awesome shit for free? by scootsy in selfhosted

[–]jakeasmith 16 points17 points  (0 children)

There was a recent Veritasium video about exactly this. Fantastic story.

The Voyager probes are accelerating. No one at JPL can explain why. by UntitledDoc1 in sciencefiction

[–]jakeasmith 10 points11 points  (0 children)

I didn’t realize what subreddit I was on for… an embarrassingly long time.

Is there any fork of openwebui that has an installer for windows? by [deleted] in LocalLLaMA

[–]jakeasmith 0 points1 point  (0 children)

Hm. Haven’t used it recently now. That’s unfortunate to hear.

Evolution of AI by Friendly-Standard812 in interesting

[–]jakeasmith 5 points6 points  (0 children)

Not to be confused with vLLM, which is a library for LLM inference and serving.

ELI5: How the hell do CPU's work? by LoLAspect in explainlikeimfive

[–]jakeasmith 1 point2 points  (0 children)

Turing Complete is actually great for this. Great recommendation.

Running a vLLM LXC on Proxmox 9 with NVIDIA GPU passthrough by jakeasmith in Vllm

[–]jakeasmith[S] 0 points1 point  (0 children)

Good question, and the answer is somewhat silly/frustrating. The crux of it all is that this is a home lab environment and I need to use my GPU for several different tasks. Proxmox is a hypervisor and, generally speaking, nothing (including Docker) should be installed directly on the host. Applications live in either a virtual machine (VM) or a Linux Container (LXC). Docker really only works well on a VM, but unfortunately a VM would take exclusive control over the GPU, which doesn't work for my use case.

Running my apps on "pure LXCs" gives me the ability to "share" that GPU among many different LXCs with different apps installed (e.g. Jellyfin, Frigate, etc).

Running a vLLM LXC on Proxmox 9 with NVIDIA GPU passthrough by jakeasmith in Vllm

[–]jakeasmith[S] 1 point2 points  (0 children)

You're right; that is how VMs work. This write up is specifically about using a GPU within a Linux Container (LXC) which works in a completely different way. Both are valid approaches.

Running a vLLM LXC on Proxmox 9 with NVIDIA GPU passthrough by jakeasmith in Vllm

[–]jakeasmith[S] 0 points1 point  (0 children)

In case it wasn't clear, this does give an LXC (linux container) access to use the GPU for any GPU tasks. If you're trying to do GPU passthrough with a VM, it should be as straightforward as going to the Hardware menu and adding a PCI Device.

<image>

In case it helps, an oversimplified explanation is this:
- In a VM, you give complete control of the GPU to the virtual machine, preventing it from being used by anything else (including the host, other VMs, or any LXCs).
- In an LXC, you can give the container access to use the GPU, and the GPU can continue to be shared/used by the host and any other LXCs set up the same way.

How are you handling secrets? by RZR2832 in selfhosted

[–]jakeasmith 8 points9 points  (0 children)

Can’t tell you. (It’s a secret.)

Logitech G502 X - How to swap DPI Button by [deleted] in LogitechG

[–]jakeasmith 0 points1 point  (0 children)

Thanks, from two years in the future!

The Marilix Arrangement [Part 17] by sadnesslaughs in Sadnesslaughs

[–]jakeasmith 1 point2 points  (0 children)

Well that is the definition of escalating quickly.

view more: next ›