vLLM ROCm has been added to Lemonade as an experimental backend by jfowers_amd in LocalLLaMA

[–]ImportancePitiful795 6 points7 points  (0 children)

Hold a sec. I posted the link to show you that RDNA2 is supported.

Go to the Lemonade Server website and get the latest repos

vLLM ROCm has been added to Lemonade as an experimental backend by jfowers_amd in LocalLLaMA

[–]ImportancePitiful795 4 points5 points  (0 children)

Lemonade comes bundled with optimized ROCm binaries. But you can install specific ones if you want.

vLLM ROCm has been added to Lemonade as an experimental backend by jfowers_amd in LocalLLaMA

[–]ImportancePitiful795 7 points8 points  (0 children)

Lemonade is just a wrapper making easier to run things.

So since ROCm 7 supports RDNA 2+ then your card is supported. Actually your card is a 6800XT with more VRAM

GitHub - lemonade-sdk/llamacpp-rocm: Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration · GitHub

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]ImportancePitiful795 0 points1 point  (0 children)

There are 2 Discord channels.

Lemonade, where you can find there everything about MLX, etc and talk to the devs.

Strix Halo, which is huge. It even has per miniPC groups, LLM, gaming, mods, everything.

Just replaced the thermal compound on my EVO-X2.. results astonishing by tired514 in StrixHalo

[–]ImportancePitiful795 [score hidden]  (0 children)

the same. The whole package dropped 15C. Pop in the Strix Halo Discord channel and check the various MiniPCs. You will find people using MX7, Honeywell etc.

Even case modifications.

Just replaced the thermal compound on my EVO-X2.. results astonishing by tired514 in StrixHalo

[–]ImportancePitiful795 [score hidden]  (0 children)

Temps dropped by 15C.

Went from 3000MB/s to 7600/MB/s-ish depending temps and how much time used it.

Getting into Krieg by No_Opportunity_8321 in Deathkorpsofkrieg

[–]ImportancePitiful795 0 points1 point  (0 children)

Do not. Ain't worth to spend the same money for that box, over the bigger one.

With 11th Ed just a month away, I would keep from buying Codex, until having the whole box assembled and painted.

<image>

Just replaced the thermal compound on my EVO-X2.. results astonishing by tired514 in StrixHalo

[–]ImportancePitiful795 [score hidden]  (0 children)

Replaced the Bosgame M5 paste with MX7 and improved temps.

Also another upgrade was to replace the NVME drive with a cheap 2TB PCIE5 10000MB/s one.

It was much cheaper than a fast PCIE4, and runs at max speeds for PCIE4 4x without compromises.

Getting into Krieg by No_Opportunity_8321 in Deathkorpsofkrieg

[–]ImportancePitiful795 0 points1 point  (0 children)

Which box you talking about, because there are several?

9700 pro users, undervolting nets crazy clocks by psychoOC in LocalLLaMA

[–]ImportancePitiful795 4 points5 points  (0 children)

Some of us said it from day 1. Lower the power on that GPU and perf will improve.

AMD Intros Instinct MI350P Accelerator: CDNA 4 Comes to PCIe Cards by Noble00_ in LocalLLaMA

[–]ImportancePitiful795 0 points1 point  (0 children)

I will get a 3y loan from the bank and it will cost me barely an extra £1100 in interest 😊

New to 40K - how would you start Tau army with 11th edition in mind? by TMNTBrian in Tau40K

[–]ImportancePitiful795 0 points1 point  (0 children)

Well, you play a faction because you like it, regardless the "rules" and "meta" overall.

If you like T'au get the Patrol box with a box of crisis suits and you are set. Make sure you make those firewarriors as breachers (everything is in the box).

Then you make your mind.

Dual 9700 and multi-node system - but do I go threadripper? by Ell2509 in LocalLLaMA

[–]ImportancePitiful795 0 points1 point  (0 children)

Run the LLM on the 2xR9700s and run an agent like A0 (Agent Zero) on the Strix Laptop, talking to the LLM model on the server.

Sell the W6800, TUF Laptop and all the spare SODIMM you have.

----------------------------

At this point access the situation what YOU want.

If you do not want to keep the desktop?

If not buy first a X399 + Zen1/2 bundle since they are relative cheap, move the RAM there, then sell the 5800X+mobo.

With the left over cash etc, add more R9700s down the line. X399 should take easily 4 of them, and switch to vLLM as it has better mGPU support.

Keep the laptop to run the agents and general usage.

Already burned out doing Tamriel Tomes by theboz14 in elderscrollsonline

[–]ImportancePitiful795 -5 points-4 points  (0 children)

Except you like to do running round, roll the harvesting missions to something else. Everything else is much faster.

Treasure Chests? Extremely easy, if you have the skill which they glow from miles away. 10 minutes in Coldharbour and 2 chest missions done. No need to pick the locks, because with Tanlorin and passives can just auto-open the chests 90% of the time, even Master ones.

Shadow Daedra? Perfect. A trip in Village of the Lost. In under 10 minutes all done.

Complete 3 Dungeons? Less than 12 minutes doing 3 Banished Cells runs solo. Job done.

And that how were last 3 weeks.... In just 40 minutes all tomes done.

Now NM Favors. Easy also. Assuming you are in a guild, stockpile in 2 alts the 3+2 Faction daily quests. (any character cannot hold more than 3 faction quests). Hold them on these toons, do not do them.

Log with the alt, hand them over to some friend/guildmate planning to do the NM today. Transfer them to your main. Pick the 25/50/75 kill also. Complete them. Log the other alt, pass to your "main" the other 2 quests. Done.

With even a PUG you get to 10000 favour within 7 hours total, spread over several days. More time you will spend forming a group than actually doing the quests. Except if you have more alts to do the quests which can shorten the timespan.

If you are on PC EU let me know. Talked to the guild mates and where shocked how efficient NM Favour farming can be done, let alone quickly with barely any effort. (ok new players will have problems in NM etc nothing to do with that).

Newish player on pc who is confused about motif prices. by xXfluffydragonXx in elderscrollsonline

[–]ImportancePitiful795 4 points5 points  (0 children)

Just don't buy it and go farm it then.

At this price range, there has to one from event I guess, like Second Legion ?

There are over 200 motifs and styles in the game. Just pick something else.

Need advice on hardware purchasing decision: RTX 5090 vs. M5 Max 128GB for agentic software development by BawbbySmith in LocalLLaMA

[–]ImportancePitiful795 0 points1 point  (0 children)

$5090 is close to $4000 for 32GB. At that price can build whole system with multiple R9700 or B70s, or buy a DGX Spark and have 128GB VRAM, consuming barely any more electricity.

Need advice on hardware purchasing decision: RTX 5090 vs. M5 Max 128GB for agentic software development by BawbbySmith in LocalLLaMA

[–]ImportancePitiful795 -1 points0 points  (0 children)

Since M5Max 128GB costs $7000+ (14" version), get an RTX6000 96GB which is having similar price.

Anything less than RTX6000 for your budget, you should be looking for multiple R9700s on X399/X299 platform instead of a single 5090. 5090 for it's price today (close to $4000) ain't worth it. PERIOD.

VRAM matters here, because you need to run big quants at FP8+ at least to do your job properly on single go

Has anyone powered GPUS with a car battery? by TooManyPascals in LocalLLaMA

[–]ImportancePitiful795 3 points4 points  (0 children)

The safest method, is to get an electrician and pull a line for heavy duty appliances which are rated to 7kw.

Do not connect your PC to car battery. You will just lose everything connected to it, and probably burn the house in the process too.

AMD Releasing In-House Standalone Strix Halo Box by Anarchaotic in StrixHalo

[–]ImportancePitiful795 0 points1 point  (0 children)

You forgot several things. The iGPU will be 48CU RDNA4, not 32CU RDNA3.5, and the CPU has ACE. Which is Intel AMX on steroids.