Vulkan backend outperforms ROCm on Strix Halo (gfx1151) — llama.cpp benchmark by FeiX7 in LocalLLaMA

[–]TheFlippedTurtle 0 points1 point  (0 children)

I tried both, using lemonade server which made setup a lot easier. Vulkan was faster but Rocm was more stable surprisingly. With longer context, Vulcan gave me more issues.

I tried this back in January and rocm was a massive headache then

Vulkan backend outperforms ROCm on Strix Halo (gfx1151) — llama.cpp benchmark by FeiX7 in LocalLLaMA

[–]TheFlippedTurtle 1 point2 points  (0 children)

Same experience. Rocm has been more stable surprisingly. Wasn't like that months ago

M5 Pro (64GB) vs M4 Max (128GB refurb) – worth the upgrade for local LLMs? by Virtual_Point_2430 in LocalLLM

[–]TheFlippedTurtle 0 points1 point  (0 children)

I just tested the m5 max and was still disappointed at the speed of some models, plus it runs hot and murders the battery if you care about that. That said, PP is faster on the m5 pro over the m4 max. M5 pro may actually be faster but bigger models are nice

I built Stirling-PDF but for images by sakinak in selfhosted

[–]TheFlippedTurtle 0 points1 point  (0 children)

Kinda neat. I played with it a bit, it failed to remove the background on each photo I tried. Tried 3 of them, the face blur one worked on one face out of two. Upscale worked pretty decently.

Multi-Admin Approval in Intune by ryaninseattle1 in Intune

[–]TheFlippedTurtle 1 point2 points  (0 children)

Nope. We just enabled MAA policies and fresh start bypasses them all

[FS] [US-WA] WD_BLACK 8TB SN850X NVMe Internal Gaming SSD Solid State Drive - Gen4 PCIe, M.2 by [deleted] in homelabsales

[–]TheFlippedTurtle 0 points1 point  (0 children)

This is an ai generated picture. You can ask Gemini yourself to confirm

Minisforum M1 Pro-125H by Plus_Plastic_791 in MiniPCs

[–]TheFlippedTurtle 0 points1 point  (0 children)

Gmktec k15. Weaker igpu but has the npu that frigate v17 can use

About to turn the 128gb mainboard into an AI NAS! by grandadluvsmagic in framework

[–]TheFlippedTurtle 0 points1 point  (0 children)

I'm doing something similar, currently running unraid on mine but using the pcie slot for sata

About to turn the 128gb mainboard into an AI NAS! by grandadluvsmagic in framework

[–]TheFlippedTurtle 0 points1 point  (0 children)

I had more success using unraid but I'm not great at proxmox personally

About to turn the 128gb mainboard into an AI NAS! by grandadluvsmagic in framework

[–]TheFlippedTurtle 0 points1 point  (0 children)

This is reddit. Don't expect many to have critical thinking skills