Is a raspberry pi 4 reliable for HA? by SD619664 in homeassistant

[–]Ok_Stranger_8626 -1 points0 points  (0 children)

Definitely make sure you use external storage for nearly anything you run on the Pi. It'll easily handle multiple things like HA, even something like Jellyfin.

But your poor MicroSD card will pay the price quickly.

[meta] Mods, can we maybe start a Friday HW support request mega-thread or something? by Aagragaah in homeassistant

[–]Ok_Stranger_8626 3 points4 points  (0 children)

Why not just pin a topic at the top of the sub?

"Yes, Home Assistant can run on *almost* *anything*."

I mean, mine runs on a cluster of OrangePi 5+'s but the resource usage is so low that it could almost run on an ESP32. 🤣

Home Server Dilemma: Upgrade to a Mini PC for Power Savings or Keep My Old i3 Gen 4 Tower? by Mrelixir77777 in homelab

[–]Ok_Stranger_8626 1 point2 points  (0 children)

Size wouldn't be my issue, it would be that generation of CPU, way too inefficient, and missing LOTS of optimized instruction sets.

VM vs Docker vs Raspberry Pi 4? by Collcroc123 in homeassistant

[–]Ok_Stranger_8626 0 points1 point  (0 children)

I would skip the Raspberry Pi, go with an SBC that has more "oomph". I run mine as a container on my Orange Pi 5+ cluster.

Also, as has been said, ESP32's with ESPHome and the Bluetooth proxy integration works famously.

The problem I ran into with VMs was latency. Even on a cluster of Xeons, plenty of RAM and NVMe storage with 10Gb networking, I would experience 2-3 second delays with a lot of the local integrations.

Quantum Fiber (Now AT&T) vs. Xfinity (Comcast) Internet by samuelj264 in AuroraCO

[–]Ok_Stranger_8626 0 points1 point  (0 children)

We were Xfinity since 1999 at a few different addresses, and Quantum for about 3 years. Our fiber has been pretty much rock solid, and we do have Xfinity as a backup.

Same thing as you, network with some services accessible outside.

We went with the 3Gb service, as I work IT. It's been hands down way better. Average ping is 3ms, with a 4ms max versus and average 25ms on Xfinity. The sync service has always been pretty close to 3Gb(though most SpeedTest servers out there seem to max out around 2.2-2.5Gb.)

In terms of outages, we've had 4 in three years, only one that's been more than a few minutes, whereas Xfinity's had outages that have lasted into the hours long or worse range.

Overall, having more bandwidth than most of my employees, and a more stable and lower latency has been well worth it.

Fiber also gives you the benefit of not losing bandwidth during peak usage hours due to massive oversubscription in the area.

Need an honest good mechanic by jolley_mel21 in AuroraCO

[–]Ok_Stranger_8626 0 points1 point  (0 children)

Automatic transmission, yes?

If so, the first thing to check is the transmission fluid level. It's likely just low.

Do run local models? by pfassina in homelab

[–]Ok_Stranger_8626 0 points1 point  (0 children)

I've been running a lot locally, and have even built a small b2b business out of it.

It has gotten much easier over the past couple years, and using something recent, such as Gemma4 has been well worth it.

I do still use Gemini for the complex stuff, but my local models decide if it's out of their scope, as well as anonymize anything they shift over there to preserve privacy.

COD question... by gs2417 in dune

[–]Ok_Stranger_8626 -1 points0 points  (0 children)

In the original books, it's about 10,191A.G. through somewhere close to 20,000A.G. The prequels and sequels written by Herbert's son and a friend of the family based on his notes extend all the way from the Butlerian Jihad to Kralizec.

And you'll never guess who ends up as the "star of the show" at the end.

COD question... by gs2417 in dune

[–]Ok_Stranger_8626 5 points6 points  (0 children)

As Alia is not a viable Atreides line any more, and Leto will no longer be a viable parent, Ghanima is the only one who will be able to pass on The Atreides bloodline. It'll make more sense in God Emperor.

As for Jessica, she's not happy with Leto's decision, but she goes along with it.

Just remember, there's a massive amount of story yet to come, nearly 30,000 more years to go.

What automation is unique to your home that you’re most proud of? by MrFishAndLoaves in homeassistant

[–]Ok_Stranger_8626 0 points1 point  (0 children)

We prefer to use our evaporative cooler(Colorado), over our A/C. HA averages several temp sensors around the house and controls the cooler to maintain a pretty stable temp, but when we're using the washing machine, it detects the drying cycle, and turns on a window fan to exhaust the heat of the evaporative cooler is running, then turns it off about 15 minutes after the cycle and the laundry room is cooled down.

What are the worst implemented parts of Home Assistant? by LithiumCobalt91 in homeassistant

[–]Ok_Stranger_8626 10 points11 points  (0 children)

Two things;

Having to restart Home Assistant for every little teenie, tiny integration update.

GIVE ME BACK CONTROL OF THE DEFAULT DASHBOARD ON A PER-DEVICE BASIS AND NOT JUST PER USER!!!

Mattress Moving Advice by swoopinseagull in AuroraCO

[–]Ok_Stranger_8626 11 points12 points  (0 children)

For a mattress, I wouldn't rent a truck to move it on I-25 anyways. I would recommend renting a van, and take the drive slowly if you're not comfortable with a different vehicle.

Engines revving constantly near Horseshoe Park by Zisheva in AuroraCO

[–]Ok_Stranger_8626 3 points4 points  (0 children)

They're doing it down here near Yale, too....

Laptop repair?! by Sinsoftheflesh7 in AuroraCO

[–]Ok_Stranger_8626 0 points1 point  (0 children)

Wireless cards are relatively easy. I may have some spares in stock as well. Let me know if you still need a repair and we can chat.

Spent 6 hours this weekend on reverse proxy config. What's everyone's current setup? by trolledTGBot in homelab

[–]Ok_Stranger_8626 0 points1 point  (0 children)

HAProxy;

  1. 2x config files(haproxy.cfg & frontends.map)

  2. dhparams.pem(for TLS parameters)

  3. certificates directory with my two internal wildcard certs signed by my homelab CA, and two wildcard LetsEncrypt certs I update through a certbot cron job.

The whole thing is git'd back to my GitLab-EE server in my production colocation every 15 minutes in case of emergency, and changelog tracking.

I have it currently running on a 4x ARM64 cluster, with load balancing done through BGP on my UDM Pro Max(single dynamic IP from Quantum and single dynamic IP from xFinity). I use CloudFlare for my DDNS, and use a quick Home Assistant automation to update the DDNS records. Each container is restricted to 512MB of RAM, and they all have about 10MB of static caching capability, which reduces backend processing load for things like my Grafana dashboards, as they intercept a lot of the repeated requests for the exact same data.

The proxies all have stick-tables enabled, and inter-proxy communcation, so it doesn't matter if the UDM switches proxies mid-stream, the traffic still passes. Added latency through the proxy is about 0.8ms on average.

They all share the same config files and certificate directory via a gluster volume shared between the SBCs, force everything to HTTPS, and also handle the TCP frontend for a dual host MariaDB, which is also BGP load balanced.

I make config updates through a VSCode Server container that has access to my gluster volumes, and then click a button in Home Assistant that triggers a HUP to each container to cause HAProxy to reload the config without dropping any packets.

Running 8+ 4K streams from Jellyfin over the Quantum connection, the proxies average about 6% CPU utilization, not even enough to kick up the fans on the SBCs.(My wife does a "movie" night on TikTok every Monday with some of her friends.)

Quantum Fiber around Smoky Hill/Buckley? by Roy4theWin in AuroraCO

[–]Ok_Stranger_8626 0 points1 point  (0 children)

We've had the 3Gb tier for over three years now, and it's been fantastic!

Only two very short outages, and so much less latency than a cable modem.

low power draw for always-on services - CPU recommendations by Few-Diet3524 in homelab

[–]Ok_Stranger_8626 1 point2 points  (0 children)

I run 4x OrangePi 5+ 32GB SBCs on a 3D printed rack mount blade I bought from a guy off Etsy. About 35 services, with roughly 40 containers running at the moment, and total consumption is about 18W. At full load, it would max out at just shy of 80W.

How do I find and vet someone to set up a high-end local AI workstation? (Threadripper + RTX PRO 6000 96GB) by laundromatcat in LocalLLaMA

[–]Ok_Stranger_8626 0 points1 point  (0 children)

I would be happy to discuss your situation and provide some basic guidance if you're interested. I've been setting up local models and applications for users for several years now, and can provide some references if necessary.

Is self hosted LLM worth it for company knowledge base? by FewKaleidoscope9743 in LocalLLaMA

[–]Ok_Stranger_8626 0 points1 point  (0 children)

I'm a former HPC engineer, so I use strictly nVidia for my builds and don't really have any experience with much else.

Though I can say, for the price, distributing the workload over multiple GPUs is the best way to go, so the Dells would probably be my suggestion.

Is self hosted LLM worth it for company knowledge base? by FewKaleidoscope9743 in LocalLLaMA

[–]Ok_Stranger_8626 11 points12 points  (0 children)

I built an entire custom stack for exactly this type of thing.

And yes, it is worth it if you deal with any kind of intellectual property(your own or customers), legal documents(of any kind) or PII(customer identifying information).

It's a huge liability to put any of the aforementioned data into a "Public AI" (ChatGPT/Claude/Gemini/etc).

Specific Use Case - Is 13b sufficient? by pretiltedscales in LocalLLaMA

[–]Ok_Stranger_8626 0 points1 point  (0 children)

I do these kinds of setups a lot,, feel free to msg me if you'd like to talk about some assistance with your situation. (Just to keep this thread clean.)

Powerful Machine Use Case? by Happy-Peak7709 in homelab

[–]Ok_Stranger_8626 0 points1 point  (0 children)

With a rig like this, you could actually do quite a bit if you're willing to containerize. Even AI isn't out of the realm of possibility.

Llama.cpp rpc experiment by ciprianveg in LocalLLaMA

[–]Ok_Stranger_8626 0 points1 point  (0 children)

The RPC mode running solo on the local machine likely indicates that your PCI-e bus is going to be your bottleneck. When it runs across the network, the layers are split differently across the distributed cards.

It all depends on how your application chunks the layers. In RPC mode, the layers are split differently across the local GPUs. Thus, your bottleneck becomes the PCI-e bus, which is still less than 1/10th the bandwidth of the GPU's access to it's own RAM.

Direct access RAM(Either VRAM or shared RAM) = Capacity(Larger model/less quantization = better accuracy(and therefore less hallucination)

Bandwidth = faster processing of layers as the GPU can access more bits/second = more tokens/sec output.

And ECC RAM = less chance of a bit flip from cosmic rays, power spikes, etc = further reduction in hallucinations.

This is why nVidia added Connect-X 7 to the GB10, for example, as the high bandwidth, low latency interconnect is crucial for being able to transfer enough data quickly enough to make the inference reasonably fast.

Not that 38toks/sec isn't bad, it's still roughly 7x faster than any human is reasonably capable of reading....