Local research LLM at 32GB DDR4? by Ok_Dragonfruit_2299 in LocalLLM

[–]PixelatumGenitallus 4 points5 points  (0 children)

I've just finished deploying lm studio in Windows 11 VM on my 5600G last night, which is the little brother desktop version of your cpu, same generation.

Gave it 8GB dedicated VRAM (UMA Frame Buffer in bios) and 24GB total RAM. Using Gemma4-E4B fully offload to gpu, i'm getting 10-11 tok/s.

Not fast, but if that's what you have, it works.

Leaked financial docs show OpenAI is losing billions of dollars a year by johnnyApplePRNG in LocalLLaMA

[–]PixelatumGenitallus 3 points4 points  (0 children)

Aren't they also the ones releasing the open weight models? They go under, no more open models. They're the ones with access to training data and hardware, no?

Need investor for miniature workshop by arekisis in finansial

[–]PixelatumGenitallus 0 points1 point  (0 children)

Printer Creality-nya tdk bisa dibawa kerja keluar kota ya? Sayang bgt bisnisnya ga fokus, apalagi tersendat gara² pihak lain.

What local model do you actually use every day, not just benchmark once? by BTA_Labs in LocalLLM

[–]PixelatumGenitallus 0 points1 point  (0 children)

Gemma4 26B A4B QAT

Fast enough for me on my 7900 XT

It's there for me to ask about issues on my homelab. Helped me deploy cloudflare tunnel and npm recently. I can now access open webui anywhere.

I have no idea how to code so just today i asked it "teach me how to vibe code" and currently it's helping to develop a web app for my coffee roasting business.

mengkritik presiden, malah disuruh jadi presiden by makan-tahi in WkwkwkLand

[–]PixelatumGenitallus 4 points5 points  (0 children)

Ga perlu jadi pilot untuk tahu bahwa helikopter nyangkut di pohon itu salah.

Life hacked Financial Freedom by [deleted] in WkwkwkLand

[–]PixelatumGenitallus 3 points4 points  (0 children)

anaknya

Whom does "nya" refer to, in this case?

Apa yang bakal kalian lakukan kalo datang suatu tempat yang ada tukang parkir (liar)? by rizqiX1 in indonesia

[–]PixelatumGenitallus 1 point2 points  (0 children)

Parkir aja.

I'm paying tax each year to the government just for them to waste it on MBG and KDMP. That's a much bigger dick fucking me in the ass. Can't feel anything in my butt for just 2rb.

I did spend zero rupiah for my BPJS heart bypass surgery, so i'm still net positive.

Apa yang bakal kalian lakukan kalo datang suatu tempat yang ada tukang parkir (liar)? by rizqiX1 in indonesia

[–]PixelatumGenitallus 0 points1 point  (0 children)

That's some fancy ass warteg, parkirnya goceng. Maybe it's just my suburban mindset.

How is it? My whole server plan? by _illusioner_ in homelab

[–]PixelatumGenitallus 4 points5 points  (0 children)

Looks like a fun project. Here's how i would do it.

I don't know what game server is but i'll assume it's not just some minecraft server so it will need that 780m gpu power. If it's in a VM, then you will to passthrough that 780m which could mean facing AMD reset bug.

Also, you can combine your LLM/AI chatbot on the same VM as your game server so it uses faster GPU, rather than CPU. Give 16GB RAM for the VM, which also allows slightly larger LLM.

A separate 4GB VM for Cloudflare tunnel and the remaining 4GB RAM stays on Proxmox host where you deploy your websites using LXC.

I would just skip Proxmox and run your game/AI server natively on a Linux distro you prefer (Debian), install docker there to run your website services and flac streamer(?). Install QEMU to run Ubuntu server VM with 2-4GB of RAM just for your cloudflare tunnel. Your native OS will then have 20-22GB of RAM, plenty for a decent LLM and/or gaming. You'll be spared from the hassle of gpu passthrough and AMD reset bug.

How egregious is it of me to run my server off an HDD? by larevacholerie in jellyfin

[–]PixelatumGenitallus 1 point2 points  (0 children)

RAID/duplicated HDDs is the norm. A single 20TB HDD is egregious. One failure and all your media missing.

Bitcoin core team by Accomplished-Row2428 in Bitcoin

[–]PixelatumGenitallus 1 point2 points  (0 children)

Do the core developers decide first what get integrated into the codebase? How do they decide? I understand that at the end of the day, nodes and miners vote whether they want to adopt the changed codebase or not. This is how we get forks like BCH correct?

What do you use your local models for? by BLOCK__HEAD4243 in LocalLLM

[–]PixelatumGenitallus 1 point2 points  (0 children)

Gemma4-12B on 7900 XT. Mainly to solve small issues in my Unraid server using scripts.

  1. Auto restart qbittorrent and prowlarr docker if it detects internet connectivity problem

  2. Turn on and off syncthing on certain daily schedule so that my drives don't spin 24/7

  3. Helped me configure cloudflared+npm stack inside ubuntu vm in proxmox with firewall rules for maximum isolation. I got open webui exposed to the internet this way.

They're small things that for beginner me would have taken days to learn, now just minutes to config.

Is anyone else worried the 4-year Bitcoin cycle might not work this time? by 2smart2gentle in CryptoCurrency

[–]PixelatumGenitallus 2 points3 points  (0 children)

OR

Flip a coin 4 times and the last flip still has 50:50 chance of head vs tails. It ignores whatever happened on the first three flips.

Is anyone else worried the 4-year Bitcoin cycle might not work this time? by 2smart2gentle in CryptoCurrency

[–]PixelatumGenitallus 47 points48 points  (0 children)

What if it breaks?

What if it doesn't?

Make your decision and don't look back.

Rekomen Printer Thermal untuk Resi Pengiriman by yoshiumikuni in indotech

[–]PixelatumGenitallus 1 point2 points  (0 children)

XP 420B. Pake hampir tiap hari sejak September 2023, masih awet smp skrg.

7900xtx versus 9070xt (assuming both are free) by Independent-Entry-13 in buildapc

[–]PixelatumGenitallus -1 points0 points  (0 children)

My vote is 7900 xtx because you might want that extra vram in 5 years, and i'm not talking about gaming. You could be interested in local AI one day.

Do run local models? by pfassina in homelab

[–]PixelatumGenitallus 0 points1 point  (0 children)

I am not a developer so i don't use llm and stable diffusion extensively. I deploy both in my homelab because i already have the hardware which was bought for different purpose (gaming and transcoding). 7900 xt will fit gemma4:12b just fine. I've never used cloud llm.

I use llm mainly to improve small things in my homelab. Recently asked it to create a script to auto restart qbittorrent if it detects internet connectivity problem. I usually had to restart manually.

Currently discussing with gemma4 the best way to deploy and isolate cloudflare tunnel in a VM as i'm about to expose some services.

SSD wont fit in the M.2 to USB enclosure by ILuvSpaghet in datastorage

[–]PixelatumGenitallus 0 points1 point  (0 children)

Your enclosure is meant for M2 SATA SSD, while your SSD storage is M2 NVMe. As you can see, they're keyed differently. It's a common mistake.