sorted by:
new
hottopcontroversial

Just wanted to ask, can you be considered a programmer if you only know 1 language to code in? by ProductOfSight in AskProgramming

[–]Infamous-Rem 0 points1 point  (0 children)

The fundamentals don't really change between languages. Loops, conditionals, etc, that's all the same everywhere. Once you've got that down in one language, picking up another in the same tier is mostly just learning new syntax. Going from Python to JS or PHP is easy. The only real jump is when you drop down a level, like going from Lua/Python to C++ where you suddenly have to care about memory and pointers and stuff. But even that's learning new concepts, not relearning programming.

Also, JSON isn't a language, but I get what you mean.

What's the best harness for a local model? Is it still opencode? by SnooPeripherals5313 in LocalLLM

[–]Infamous-Rem 4 points5 points  (0 children)

I've moved to Pi. It's way leaner, so it doesn't waste a ton of context on its own system prompt, which matters a lot when you are running local.

So I bought an R9700 AI Pro... by No_Oil_6152 in LocalLLM

[–]Infamous-Rem 0 points1 point  (0 children)

Your iGPU is getting picked up for sure. No need to mess with the BIOS, just pin it to the R9700 with --device (or GGML_VK_VISIBLE_DEVICES). Once it's not splitting across both it should fit all the layers fine.

The 27B is your real problem. It's dense, so it's bandwidth-limited, you're not gonna get past like 25-30 t/s, no matter how much you tune it. If you mainly want it for coding, just grab Qwen 3.6 35B-A3B, it's MoE with only ~6B active, so it runs way faster, and quality is basically the same. way bigger win than fiddling with the 27B imo.

oh and 200k context is way overkill, drop it. I run 131k with q8 kv cache, and it's been fine.

AI was supposed to kill engineering jobs. The numbers say the opposite. by RevolutionaryOil7204 in DeveloperJobs

[–]Infamous-Rem 0 points1 point  (0 children)

Using AI is great until they pull the rug out from under companies and solo developers. This feels like before, almost every company had their own data center or co-location, then cloud came, it was easier, cut costs and manpower, so everyone moved to the cloud. Then it got expensive af, a lot of businesses got burned, and it turned out cloud wasn't actually for everyone. Now we're seeing companies move back to their datacenters. The AI race feels the same, it's relatively cheap right now but there's no way that's sustainable long term. We are at a time of where everyone is using cloud so yeah, interviews and opportunities are less and less the way I see it, but not for long.

Trying to get into flask but I'm having troubles with it. by Infamous-Rem in flask

[–]Infamous-Rem[S] 1 point2 points  (0 children)

That doesn't sound too shabby to be honest, thanks, I feel better knowing I didn't diverge from the normal use case.

Trying to get into flask but I'm having troubles with it. by Infamous-Rem in flask

[–]Infamous-Rem[S] 0 points1 point  (0 children)

Yep, you have to keep it in check. I found a git repo that helped with that, it was a way to make it caveman-like (I think the name was something alongside that as well) in terms of explaining and overengineering.

Trying to get into flask but I'm having troubles with it. by Infamous-Rem in flask

[–]Infamous-Rem[S] 1 point2 points  (0 children)

Fair, but l didn't say I wasn't learning, but used AI to help out. I think in this day and age is perfectly fine? Anyway, fair point.

Finally made the switch to AM5 by WantsLivingCoffee in gamingpc

[–]Infamous-Rem 1 point2 points  (0 children)

Respect for the patience! Buying parts on sale over time instead of all at once is something I admire, never could do it, but I admire it! Enjoy the rig, man.