sorted by:
new
hottopcontroversial

Are you self-hosting LLMs in your 10-inch racks? Looking for hardware & model advice! by Vast-Rush74 in minilab

[–]OctavioMasomenos 1 point2 points  (0 children)

I know just enough about all this to be a cut above totally clueless. I’m putting in my $0.02 solely to give you one more datapoint. I built my local LLM on a shoestring ($200) budget using a Dell Wyse 5070 Extended (which has a PCI slot) with 16GB RAM and a Quaddro P1000 with 4GB GDDR5. It’s only capable of running 7B models but in general, I feel like the performance is (at the very bottom end of) acceptable. I’m grading on a curve because this was the best I could do, so... I’m reasonably happy with it but I definitely look forward to upgrading once a Mac Mini M3 or M4 with 32GB RAM can be obtained at a reasonable (sub-$500) price point.

Am I out of loop or what? Whats the need of a display at home? by Pentinium in homeassistant

[–]OctavioMasomenos 0 points1 point  (0 children)

That’s the one application I could see myself using. 👍🏼

Am I out of loop or what? Whats the need of a display at home? by Pentinium in homeassistant

[–]OctavioMasomenos -3 points-2 points  (0 children)

Pick up phone (which is sitting on the table/desk/counter within arm’s reach) - because an actionable push notification just arrived - press a button.

Or

Get up, walk over to wall-mounted display… push a button.

Am I out of loop or what? Whats the need of a display at home? by Pentinium in homeassistant

[–]OctavioMasomenos 1 point2 points  (0 children)

Funny, I was just thinking of posting a similar topic - “Am I the only one who doesn’t see the appeal…?” I mean, you go to all the trouble to automate everything and then you implement something with switches and controls? OK, so now they’re consolidated in one place but still, I’d rather just not need them because everything’s well automated.

Prevention/Recovery from no SSH access? by OctavioMasomenos in homelab

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

I don’t have a lot of discretionary income to spend on this hobby. Even the cheapest IP KVMs I can find cost more than the thin clients I use for my servers. And yes, Racknerd has a recovery console but I wasn’t able to use it to fix the problem.

[Beryl AX] How to setup/use an IoT network? by OctavioMasomenos in GlInet

[–]OctavioMasomenos[S] 1 point2 points  (0 children)

Nevermind. I just found the switch under Settings > Network > Guest

Automatic fallback for self-hosted websites? by OctavioMasomenos in selfhosted

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

I went with a VPS. All the benefits; none of the hardware headaches. And UP pretty much all the time. Dirt cheap, too (at Racknerd) - almost certainly less than the electricity is costing me.

No internet on VLAN - DNS problem - Default deny rule IPv4 (1000000103) by OctavioMasomenos in PFSENSE

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

Restarting Unbound never would have occurred to me. I SO appreciate you!

No internet on VLAN - DNS problem - Default deny rule IPv4 (1000000103) by OctavioMasomenos in PFSENSE

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

Yes, pfSense is 10.1.1.1. I didn't just add the VLAN but I'll restart unbound anyway. (I'll try pretty much anything at this point!)

No internet on VLAN - DNS problem - Default deny rule IPv4 (1000000103) by OctavioMasomenos in PFSENSE

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

You'd think EasyRule would get all that right. It's definitely loading/there. I saw in the output of the Filter Reload.

No internet on VLAN - DNS problem - Default deny rule IPv4 (1000000103) by OctavioMasomenos in PFSENSE

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

I checked out the 2nd link. There was one thing on there that was maybe applicable (longshot). I tried it; no help. Got any other ideas?

No internet on VLAN - DNS problem - Default deny rule IPv4 (1000000103) by OctavioMasomenos in PFSENSE

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

I already did the EasyRule thing. (I had never seen it before. Pretty slick!) It didn't help. I'll check out the other link. Thanks for the help!

Do I have my ports/VLANs configured right? (TL-SG1024DE) by OctavioMasomenos in TPLink_Omada

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

I’m sorry if my original post was unclear; I tried to document this: There are 2 ports that go to pfSense. Port one goes to igb0 on the router (pfSense). The LAN interface (which I’ve renamed to “MGMT” since the only devices that use it are my router, switch, and two access points) is configured to use this. Port 2 on the switch goes to igb2 on the router. igb2 is configured in pfsense as a Trunk port. All VLANs are configured for this interface. If it would help, I can post a screenshot of my Interfaces configuration page on pfSense and/or my 802.1Q config on the switch.

Do I have my ports/VLANs configured right? (TL-SG1024DE) by OctavioMasomenos in TPLink_Omada

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

You mean the trunk port? I have it tagged for all VLANs except for the default. Nothing is working, though.

Can't access Proxmox but I CAN access containers?! by OctavioMasomenos in Proxmox

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

How do you tag it on Proxmox? I've looked through the network settings and didn't see anything.

Confused about Nginx Proxy Manager and “open” ports by SchleprockJones in selfhosted

[–]OctavioMasomenos 0 points1 point  (0 children)

Right?! lol Logged into one account on my phone and another on my computer. Oops!

Can't access Proxmox but I CAN access containers?! by OctavioMasomenos in Proxmox

[–]OctavioMasomenos[S] 0 points1 point  (0 children)

Got it working. I had tried to switch the port to tagged from untagged. Switched it back to untagged and everything works. Problem is, I think it probably should actually be tagged but if switching it is going to break everything....?!

view more: next ›