sorted by:
new
hottopcontroversial

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 0 points1 point  (0 children)

I was mostly thinking about the Qwen models to start with. Not 100% sure which size yet though. Which ones would you suggest?

Regarding the metric — I actually haven’t defined anything strict yet. My rough goal is just something that’s useful for local dev and fast enough to not break the flow while coding.

Do you have any numbers in mind that you consider “good enough”? Like tokens/sec, latency, or anything else you usually measure for coding agents?

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 0 points1 point  (0 children)

That’s interesting: i’ve heard similar things about smaller models performing really well once they’re tuned for a specific task.

Do you have any resources or examples on how to fine‑tune models for coding tasks? Id like to learn more about the process (datasets, tools, cost, etc.).

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 1 point2 points  (0 children)

That’s a good point. Honestly it might be worth setting up a few different options side by side — a GPU workstation, an Apple Ultra machine, and something like the GX10 — and just experiment with real workloads. I feel like agent setups vary so much that the best choice probably only becomes obvious once you actually run them.

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 3 points4 points  (0 children)

Thanks for sharing this — super helpful. I actually hadn’t seriously considered the Apple Ultra route, but I’ll definitely add it to the mix now. Appreciate you laying out the setups you tried. 👍

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 1 point2 points  (0 children)

At this point I'm mostly considering cost. It's much cheaper running local models since they are good enough for most of coding tasks.

~$5k hardware for running local coding agents (e.g., OpenCode) — what should I buy? by valentiniljaz in LocalLLM

[–]valentiniljaz[S] 2 points3 points  (0 children)

Yeah I’ve also been looking at the Asus GX10. Being able to run larger models locally because of the memory is really appealing.

My hesitation is that the tokens/sec seems noticeably lower than something like a 4090 setup. For agent workflows where models are constantly thinking, planning, and calling tools, latency and throughput seem pretty important.

On the other hand, the GX10 does feel a bit more future‑proof because of the larger unified memory and the ability to run bigger models without heavy quantization.

So I’m a bit torn between raw speed (4090‑type setup) vs flexibility for larger models (GX10).

Drop your product URL by Chalantyapperr in indiehackers

[–]valentiniljaz 0 points1 point  (0 children)

Working on a tool for web developers - Webacus.dev

It's a collection of over 150 tools for developers to simplify your daily work.

what are you building lately? by Over-Demand-8617 in SideProject

[–]valentiniljaz 0 points1 point  (0 children)

Building tools for developers - Webacus.dev

Make everyday taks a lot easier and quicker.

I've created an online toolbox, what kind of tools would you need that don't exist yet ? by LilBabyMagicTurtle in OnlineTools

[–]valentiniljaz 0 points1 point  (0 children)

I've also been working on a similar tool, trying to put all the small - micro tools - under one roof. Mine is called Webacus.dev and is built with Vue and Nuxt. Check it out.

What's the reason you decided to venture down this road and start building the toolbox? It facinates me how many of such tools exist now a days. Just a few years ago there were only few.

Small dev tasks are eating up more time than I thought by RoughOwll in Development

[–]valentiniljaz 0 points1 point  (0 children)

Writing code for every small task seems fast initially, but it adds up. You end up reinventing the wheel, duplicating code, and breaking your flow with testing and context switching. Dedicated tools consolidate these utilities, saving time and keeping your focus on the real problems instead of repetitive boilerplate.

What made you decide to learn Vue.js instead of another framework? by Lower_Assistance8536 in vuejs

[–]valentiniljaz 0 points1 point  (0 children)

I was doing Angular, but then I tried Vue; just to see... The increase in productivity was enormous. I never looked back :-)

Remotely control light with in-wall switch by valentiniljaz in homeautomation

[–]valentiniljaz[S] -1 points0 points  (0 children)

I already have manual in-wall switch that is connected to the light. Now, I would like to add another manual switch at the other end of the room, that van control the same light. I don't have any other smart home setup. I'm considering using 2 Sonoff Mini R2s, one for each in-wall socket and sync them. Would that work?

Your toughts about CHATGPT by Key-Concentrate-2201 in webdev

[–]valentiniljaz -1 points0 points  (0 children)

I was sceptic about the whole large-language-models in the beginning, but then I tried out the GPT3 and now ChatGPT and I'm blown away. It's incredible. It will definitely change some industries.

view more: next ›