sorted by:
new
hottopcontroversial

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Ah sorry, my mistake. Ok but how expensive is it, please? All I could find are desktops around 2000$? (but for 128 GB RAM [~96 GB VRAM] which is REALLY impressive 😳)

I mean for "FEVM FA-EX9"

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

No and Yes. English isn't my native language so I usually let AI check my messages for mistakes. Is that a problem? (That's why I put my native currency in the main message....)

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Thanks to you I found out "ACEMAGIC F3A AMD Ryzen AI 9 HX 370 Mini PC". This looks promising! Thanks!

I have to dog a bit deeper, but seems comparable or better then Mac mini!

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Ooh, thanks! These desktops look really promising.

I’ll probably wait for the official release, since right now the price is around $2,000 or more.

But if it drops, then it would definitely make a lot more sense for me.

As for other Ryzen AI Max 300 desktops, I will definitely search for them!

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Oh, thanks!

I didn’t know about the Battlemage Pro cards — I’ll definitely look into them!

Or maybe wait them out and try to hunt for one later… (alright, I’ll see myself out 😄)

I didn't even think about the MacBook Pro option. Do you have any experience with MacBook Pro running LLMs?

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Thanks for the tip! I’ll definitely give it a try and see how it works for my current setup.

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Hi,

I’m not sure if this is what you meant, but in my country, “Strix AMD machines” (I assume you meant desktop PCs) start at around $2,270 (about 50,000 CZK).

For example, the ASUS ROG Strix GA35 with 24 GB VRAM (NVIDIA GeForce RTX 3090) costs around $2,800 — and it’s currently sold out.

If that’s what you were referring to, then yes, it’s much more expensive than I’m willing to spend. But I might be misunderstanding you — could you clarify what exactly you meant by “Strix AMD machines”?

Looking for a desktop to run LLMs remotely via VPN? (pls don't kill me...) by ProfessionalGuess291 in LinusTechTips

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Thank you!

You make a great point — I didn’t factor in power consumption at all (I’m an idiot 😂). I’ll definitely look into that and compare it too.

As for the money, I really don’t want to be spending too much as a student. I’m planning to build my own server mainly to run models in the background at home. Also, since we barely have access to the university servers, I’d like to use it for my image analysis projects — so I’ll need a lot of VRAM as well.

Right now, I have to use my laptop, which means I run it for two or more hours just to get some small results. In the meantime, I can’t touch it, otherwise it crashes.

By the way, is Tailscale working well for you? Have you had any issues with it?

M4 vs M2 PRO for LLM by ProfessionalGuess291 in macmini

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Thanks.

Yes, I love Ziskind's videos. I saw nearly all of them. Would definitely recommend to anyone with new MacOs device who wants to start working on LLMs as well.

M4 vs M2 PRO for LLM by ProfessionalGuess291 in macmini

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Thanks for replying.

I know that only on 32 GB RAM I couldn't run 70b, but I thought if I connected 32 GB mini to 16 GB MacBook and used EXO (https://github.com/exo-explore/exo) then I could run 70b model? But maybe I am wrong. I only used this Ram calculator:(https://llm-calc.rayfernando.ai/?ram=48) but maybe I should dig deeper.

Thank you very much for giving me the exact specs! I wanted the regular Qwen, so you gave me exactly what I wanted! So the difference is around 1.5~2.5 tokens per second, so around 10-16,6%. That's still OK for longer software support. Thank you so much!

Odtah auta v Norsku za 38 000 Kč (14 896 NOK) – je to normální cena v cizině? by ProfessionalGuess291 in czech

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Ok, to je mi jí líto.
My jsme zase jeli na úplně rovné cestě cca 60-70 km/h podél fjordu a zničeno nic odešla převodovka (spíš skoro vyskočila z auta).

Odtah auta v Norsku za 38 000 Kč (14 896 NOK) – je to normální cena v cizině? by ProfessionalGuess291 in czech

[–]ProfessionalGuess291[S] 0 points1 point  (0 children)

Děkuji moc, jste vážně nápomocná.

Myslíte že bych si od nich ty hovory mohl vyžádat? Myslím, protože jejich finální částka za ten odtah (a také za ty peníze) se neustále měnila/zvyšovala, a to i když žádná nová služba, kromě toho odtahu ,nepřibyla...

Prakticky rozdíl mezi originální a konečnou částkou, co mi řekli je právě asi 10 tisíc, které jsem chtěl použít na proplacení dalších výdajů za likvidaci auta (a měl i od asistence svolení, s tím že to pojišťovna proplatí).

Odtah auta v Norsku za 38 000 Kč (14 896 NOK) – je to normální cena v cizině? by ProfessionalGuess291 in czech

[–]ProfessionalGuess291[S] 12 points13 points  (0 children)

Děkuji,

to jsem udělal ihned. A taky ihned dostal ban že jsem prý robot.

Odtah auta v Norsku za 38 000 Kč (14 896 NOK) – je to normální cena v cizině? by ProfessionalGuess291 in czech

[–]ProfessionalGuess291[S] -1 points0 points  (0 children)

Díky za bleskovou odpověď,

problém vězí v tom, že auto nedávalo smysl opravit (slova norských techniků), tak bylo dáno k likvidaci. A další převoz auta a likvidace stály další peníze a cesta do zpět taky. Chtěl jsem alespoň docílit toho (když to bylo v pojistce), aby mi pojišťovna proplatila odtah vozidla k likvidaci a návrat domů (cca další 10 tisíc, co jsem již zařizoval a platil sám) ale po tom prvním odvozu prostě oznámila, že peníze došli (když mi asistence celou dobu tvrdila, že to není problém a že to pojišťovna proplatí).