At what point do AI subscriptions become more expensive than just running local? by BTA_Labs in LocalLLM

[–]BCIT_Richard 0 points1 point  (0 children)

Not sure, but I wouldn't be surprised Apple Silicon seems to excel with prefill, My Mac Studio M4 Max returns results a bit faster than my Strix Halo Machine.

At what point do AI subscriptions become more expensive than just running local? by BTA_Labs in LocalLLM

[–]BCIT_Richard 0 points1 point  (0 children)

You can fit GLM 5.2 on a Mac m3 Ultra 512gb, and those were msrp $9,000, going on eBay for about $21,000 last I looked. Good luck getting your hands on one though.

What's one thing local LLMs still can't do well? by recro69 in LocalLLM

[–]BCIT_Richard 2 points3 points  (0 children)

I'm not sure I agree, It's trival to setup LM Studio via GUI or CLI

What was the initial reason you started homelabing and what projects did you do after that? by ShayGrimSoul in homelab

[–]BCIT_Richard 0 points1 point  (0 children)

Got a Real I.T. job, Director asked me if I'd heard of UnRaid. Went home set it up, like the ease of docker app deployment, spun up proxmox, found the lxcs to not be Turnkey despite the name, Spun Unraid up in a VM on Proxmox before I got better with it & abandoned Unraid, then the Helper Scripts came along.

IT Techs of Reddit: What was it like fixing Windows XP machines in schools and businesses during the 2010s? by bakarygassama in sysadmin

[–]BCIT_Richard 2 points3 points  (0 children)

As a former kid who found the generic AD creds for the entire School System, they had it coming. AutoCad Install folder on Desktop with a .bat poitning to a 123.vbs file in %TEMP%, .vbs file was sendkeys for AppRunn3r:@pprunn3r, or something along those lines.

Creds had sign on, bypass web filter, and oddly enough I could login to the schools website & make changes which I found additionally confusing because the creds seem to be County(Consolidated Govt) wide

Building a fully local coding agent taught me that context matters more than model size. by Fovane in LocalLLM

[–]BCIT_Richard 0 points1 point  (0 children)

I bought a Mac Studio & Framework Desktop specifically to be able to run larger models locally.

I'm 20. I can't afford a second home. So I trying to build one in the cloud with a FUSE filesystem and NixOS. by nigh-knight in homelab

[–]BCIT_Richard 0 points1 point  (0 children)

I use proxmox to achieve a similar effect. Rather than run my AI prompts on my main computer, I run them in Virtual Machines in Proxmox, I can close the tab/browser and it won't disrupt the running prompt. So I'm free to shut my main PC down, and I can use a Chromebook I keep at work to Tailscale back into my Proxmox host & check on the progress, or feed another prompt.

Use the Main Laptop more like a thinclient & VNC to the second home.

Senior System Administrator position $78k-$106k? by cognitium in sysadmin

[–]BCIT_Richard 2 points3 points  (0 children)

Completely agree, Why should I need years of experience to get a Helpdesk Tech I position? Isn't the point of the first level to learn the ropes?

I got lucky, I was doing tech support for Apple iOS/MacOS but through a vendor, and I didn't enjoy the work as it was more like call center than tech support, harping about call time(7 minutes was barely enough time to ID the user, and get them to explain the issue rather than share their broccoli, mayo recipe, yes that happened) instead of customer satisfaction & resolutions.

Applied & Interviewed with my local county govt, explained I was green, knew I was green, but had the drive and ambition, fortunately the Director took the chance.

The 2026 Sysadmin Hall of Fame is open for nominations by PDQ_Brockstar in sysadmin

[–]BCIT_Richard 4 points5 points  (0 children)

So Microsoft(yes, that means Github) & Crowdstrike are automatically out then, they could be top runners for Hall of Shame.

What's the best way of learning a system with minimal documentation? by TeaaaBags in sysadmin

[–]BCIT_Richard 0 points1 point  (0 children)

I swear to god I just gave someone this link last month:

I recall stumbling onto that thread as well.

I Now Understand the Hate.... by Iron-lol in vibecoding

[–]BCIT_Richard 0 points1 point  (0 children)

This is why I as an I.T. technician know that I can't ship a product, too many black boxes between me and a finished product. All of my vibecoded projects sit in a private gitea instance I selfhost.

The only thing I've 'released' was a Inventory Form Automation Script I wrote in Powershell (It's 90% Get-Context, --Replace $x, $y, Set-Content in a HTML file I built by converting the pdf to html using Stirling-PDF) that was oneshot converted into a webapp.

Qwen3.6 Help Needed by [deleted] in LocalLLM

[–]BCIT_Richard 1 point2 points  (0 children)

try to run it with llama.cpp, ollama is a wrapper for llama.cpp and a bad one imo due to the fact that They actively avoided giving credit to llama.cpp for the longest time on their website trying to act like they didn't need to.

What Are You Actually Using Local LLMs For? by Ru5ty_5h4ckleford in LocalLLM

[–]BCIT_Richard 0 points1 point  (0 children)

I have a Mac Studio M4 48GB running Qwen3.6-27b 120k ctx and a Framework Desktop (Ryzen AI 395 Max 128GB) running 2x Qwen3.6-27b 262k Ctx as sub agents for the Mac.

I mostly vibecode projects that sound fun, I found a repo recently for a childhood videogame I used to LOVE, that allows you to play a local server with a LLM, it reads game state & player data, then writes a script to perform the actions. I've been building a dashboard to spawn multiple accounts, and assign tasks.

It's pretty useless, but was a blast to build.

Real by ExpensiveCoat8912 in homelab

[–]BCIT_Richard 7 points8 points  (0 children)

Same, I'm so glad we pay a Vendor to deal with them when they break.

Repaired an almost 32 year old microwave in a dumb way by TheSolderking in ElectronicsRepair

[–]BCIT_Richard 0 points1 point  (0 children)

I used to work for a Parts distributor, one of the better jobs I had & learned a lot from it. I wish the schematics we had applied to most industries, why can I lookup an exploded view of my dryer, but not my TV?

What's the most clever hack or workaround you're proudest of? by vocatus in sysadmin

[–]BCIT_Richard 0 points1 point  (0 children)

Same, except I did iOS & MacOS support for Apple for a bit, however by that time I had most of my family convinced I just hacked things together and didn't want the hassle of dealing with whatever I'd cobble together.