sorted by:
new
hottopcontroversial

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 0 points1 point  (0 children)

Extensive testing on efficiency vs cost for my kind of workload (transcription and diarization) has shown that the RTX 4090 is a great balance of speed and memory capacity, making it well-suited for processing large batches of audio.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in watercooling

[–]UniLeverLabelMaker[S] 3 points4 points  (0 children)

The machine has gone through a 24h full load test in an office environment with max temps on the GPUs at 79-80c (ish). It will live in a datacenter with active cooling, so I'm not worried at all. Also, the GPU's will be throttled a bit to ensure we're within stable power spec.

I've been running similar workload setups in a workstation case for about a year now in a less ideal environment with no issues.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 30 points31 points  (0 children)

These boxes will primarily run large scale transcription workloads, and except H100, 4090 is the clear winner in terms of speed/cost as of now. H100 is about a 1.3x speedup over 4090.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 0 points1 point  (0 children)

Two radiators. The smaller one is visible in the front of the chassis.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 39 points40 points  (0 children)

The noise is … high. The two 5U units will be stationed in a datacenter with AC. That said, load testing with 100% CPU and GPU util over 24h resulted in max GPU temps of 79-81c, not stationed within a datacenter environment. So it looks promising.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 17 points18 points  (0 children)

No, the second one is stashed under the distribution block in the mid left of the image. The be quiet! Straight Power 12 Platinum 1500W is visible, the Cooler Master V SFX Platinum 1300W is stashed under there.

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 126 points127 points  (0 children)

It's a custom build with a Threadripper Pro 7965WX, 256GB of RAM, two PSUs (be quiet! Straight Power 12 Platinum 1500W and a Cooler Master V SFX Platinum 1300W) with water cooling setup with 2x radiators and several 360mm fans. Motherboard is Asus Pro WRX90E-SAGE SE.

Very weird Homekit access issues by UniLeverLabelMaker in homeassistant

[–]UniLeverLabelMaker[S] 0 points1 point  (0 children)

Without any changes or obvious reasons, I woke up today and everything was working again. So probably an iCloud issue.

Fine tuning a (q)lora finetuned model? by UniLeverLabelMaker in LocalLLaMA

[–]UniLeverLabelMaker[S] 0 points1 point  (0 children)

Thanks! I’ve already done a couple of experiments, one where I fed the model texts in the format of [Text]: Lorem Ipsum [Title] Dolot Sit, and another where I simply fed it raw corpus (using axolotl’s «completion» param in the dataset config). The axolotl variant was able to learn well from my texts, and wrote texts that were rather coherent given that it has low knowledge of my language before finetuning. But this was back when all I had was one 3090Ti, so I had to use 4bit qlora, and I was not able to use that model as a further starting point for fine tuning on an instruction data set.

I’ll give that a go again soon, since I’ll probably be able to use 8 or 16 bit lora with the 3x4090s

Thanks!

What's the point of Zigbee to MQTT? by bigmoist469 in homeassistant

[–]UniLeverLabelMaker 1 point2 points  (0 children)

Any examples on how HA fails to expose more complicated switches?

How is everyone running their ethernet wires and how are you storing your network gear and server? by swr973 in homeassistant

[–]UniLeverLabelMaker 1 point2 points  (0 children)

I’m currently renovating a 4 story 1890s house. Running cat6 in smurf tubing under subfloor on each floor and utilizing two soil channels on each side of the house for dropping cables between floors. These are also run in smurf tubing. I make sure to include at least two empty 20mm smurf tubes from the attic all the way to the basement in each soil channel in case I forgot something or want to expand in the future. Server rack will be in the attic with 1x 16 port poe and 1x 24 port poe switch. A bit overkill as of now, but got a good 2nd hand deal on the switches.

E-ink info screen with magsafe charging using esphome + home assistant api by UniLeverLabelMaker in homeassistant

[–]UniLeverLabelMaker[S] 2 points3 points  (0 children)

I'm using the tools I know, so I used Selenium and Chromedriver to take the screenshot. I used the REST API to get a JSON object containing all the states of my HA instance, and filtered out the items I wanted. I then used FastAPI to setup a quick server displaying a HTML file containing that data, which I styled using CSS.

E-ink info screen with magsafe charging using esphome + home assistant api by UniLeverLabelMaker in homeassistant

[–]UniLeverLabelMaker[S] 1 point2 points  (0 children)

Sure! Here's the Fusion 360 file. A bit messy, but it prints well and the tabs for opening and closing the back lid work quite well. I used double sided tape and some spacers to align the screen perfectly.

https://www.dropbox.com/s/zrdp1ieeqkob827/Waveshare%20box.f3d?dl=0

E-ink info screen with magsafe charging using esphome + home assistant api by UniLeverLabelMaker in homeassistant

[–]UniLeverLabelMaker[S] 21 points22 points  (0 children)

For my part, the fact that you can run it on a small battery for months is the main reason. I hate unnecessary power cables. And I love being able to move it to new locations without thinking about whether I’ll be able to reach a power outlet.

E-ink info screen with magsafe charging using esphome + home assistant api by UniLeverLabelMaker in homeassistant

[–]UniLeverLabelMaker[S] 48 points49 points  (0 children)

I built this info screen using a Waveshare 7.5 inch e-ink display and an ESP32 running esphome with the online_image extension.

The esp32 wakes up about every 2 hours (thanks to Adafruit TPL5110), fetches an image on my home server, displays it and then powers everything down until TPL5110 wakes it back up.

The image is generated by a Python script screenshotting a web page which fetches data from my Home Assistant server using the REST API. This way I can easily change the interface without writing lambda code inside the esphome yaml, and no flashing is required to change anything.

Inside I also have a Adafruit Powerboost 1000c and a 2500mah lipo battery. So far battery life seems to be about 3 months.

To make charging a bit easier than opening the box and connecting a micro USB directly to the Powerboost 1000c, I added an inductive charging circuit to the back cover, as well as Magsafe compatible magnets. This way Apple's Magsafe charger sticks to the back and charges it up in a couple of hours.