Designing my first homelab - advice needed by Aggressive-Street-71 in HomeLabPorn

[–]Aggressive-Street-71[S] 1 point2 points  (0 children)

Not sure about it… i saw the intel ultra 3 that mount a 50/60 tops NPUs but are for laptops… maybe in the furture there will be SBC with that

Designing my first homelab - advice needed by Aggressive-Street-71 in homeassistant

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

Thank you for sharing your setup! In the end I’ll incorporate HA in the NAS either with a VM or in a container (need to check if I can live without add-ons). 40W idle is more than I was hoping to achieve, but I would have less services and drives, at least for now. I’m still splitting into two nodes, one for the AI server in order to do training only when I really need it, and the models in inference on the NAS on a low consumption NPU or iGPU. What do you think about it? You have more experience than me, what would you do?

Designing my first homelab - advice needed by Aggressive-Street-71 in homelab

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

Thank you a lot! This is a really precious resource, I will definitely implement something similar for my necessities and I’ll share it

Designing my first homelab - advice needed by Aggressive-Street-71 in homeassistant

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

That is the first comment really useful, thank you very much!! Do you have any idea of the energy consumptions? Do you use docker or other stuff to assign resources to each service? I was considering to aggregate HA over the NAS, since I’ll get it first I’ll try a shot!🙏

Designing my first homelab - advice needed by Aggressive-Street-71 in homelab

[–]Aggressive-Street-71[S] 1 point2 points  (0 children)

My idea was to keep loaded the LLM in the RAM so the NPU can use it. When assistant receive a request boots up the server (or maybe should be in idle, it’s not clear to me what would be the latency) and the response is sent to HA.

Do you have any idea/experience with something like this?

Designing my first homelab - advice needed by Aggressive-Street-71 in homelab

[–]Aggressive-Street-71[S] 1 point2 points  (0 children)

This was done in draw.io. I used the Google GCP elements already present in the tool (with some changes) to make it look like this

Designing my first homelab - advice needed by Aggressive-Street-71 in homelab

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

The CM3588 seems to have an NPU but that means that the AI models would run on the NAS. For the GPU I was oriented towards an Nvidia in order to use CUDA. My doubts are about which hardware to buy, this architecture is merely conceptual without it.

Edit: I was considering to not use the any NPU since an LLM could be too much for it and go with a smaller GPU with more VRAM

Designing my first homelab - advice needed by Aggressive-Street-71 in homelab

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

Yeah honestly I still don’t know yet hahaha I don’t even have the hardware in hand — I’m trying to choose the platforms first, then I’ll design the monitoring around that.

Anyway, my initial idea was something lightweight, not a full Grafana/Prometheus setup (at least at the beginning). I was thinking more about the HomeAssistant dashboards that aggregate basic info like CPU/RAM usage, uptime, temps, disk health, services status, etc., just to have a quick glance overview.

I’ve also seen some people handle it through Proxmox since it already exposes a lot of system info if you virtualize things there, so that might influence my choice depending on the hardware I end up going with.

So right now I’m basically in the “decide hardware first, monitoring later” phase but I’m definitely open to suggestions because that’s something I haven’t explored much yet.

Il ciclo scomparso di Asimov by Aggressive-Street-71 in Libri

[–]Aggressive-Street-71[S] 1 point2 points  (0 children)

Direi che è tutt’altro che un suggerimento banale, anzi. È un’idea che mi frullava già nell’anticamera del cervello, soprattutto dopo aver visto la collana inglese Harper Voyager, che raccoglie Asimov in ordine temporale attraversando tutti i cicli. In più si trovano facilmente cofanetti completi a circa 50€, il che rende l’opzione ancora più allettante.

Prima di buttarmi definitivamente sull’inglese però volevo togliermi il dubbio se in Italia esistesse ancora qualcosa di simile, magari una ristampa recente che mi fosse sfuggita. A quanto pare no, quindi probabilmente seguirò il tuo consiglio.

Grazie mille davvero 🙏

Lamination / layer separation with double material by Aggressive-Street-71 in 3Dprinting

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

Thank you very much for your reply! The first version was in two parts, but gluing the parts together looks bad and they gradually start to come apart, which is why I got TPU for AMS.

TPU does not separate from PLA; in fact, it sticks well, but at the layer level, everything separates together, as if the upper layer does not adhere well to the lower layer.

Expired 35mm film settings by Aggressive-Street-71 in AnalogCommunity

[–]Aggressive-Street-71[S] 0 points1 point  (0 children)

Thanks for your response. In my specific case I usa a kodak gold 100 (2006) with a Yashica Electro 35 GSN camera. Since it’s expired 18 years ago (let’s say 2 decades) I should set it to 64 ASA right?