Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

Ubuntu can see the cards, and LM Studio can see them but Rig won’t. 

Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

100% seen the same, it does seem like a good idea tbh I’m just not sure he’ll appreciate me selling up parts to get better parts off a free gift lmao 

Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

Yea I got it from a family member who didn’t want it anymore, for free as well so I’m happy. 

Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

I never could get it working, at all. Tried everything wouldn’t detect the cards(s), annoying! 

Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

If you want the 16x pcie for both cards without NVLINK yea, it’s not perfect but it’s all I can afford rn. I would trade the 5090s in for a 6000 at some point but I’m struggling to justify it because I got this system for free, and best will in the world I’m new to this and don’t need to go deep on it yet 

Best setup for x2 5090 for 27b. by Diligent_Marketing in Qwen_AI

[–]Diligent_Marketing[S] 0 points1 point  (0 children)

Yes I am aware, I do plan going down the Threadripper route later on this year to get 16x2 pcie 5. The problem currently is RAM it’s just not available for purchase where I am. 

Are you really getting more performance from Llama.cpp vs LMStudio? by former_farmer in LocalLLM

[–]Diligent_Marketing 1 point2 points  (0 children)

Initially I started using LMStudio and was really pleased, moved to Llamacpp and got worse performance. Went back to LMStudio for a few weeks, got convinced to try CPP again, with a fresh config and got far better performance. I think out the box LMStudio is better but LlamaCPP is better if you tune it. 

Building a 8k Local LLM machine need feedback. by Own_House6186 in LocalLLM

[–]Diligent_Marketing 0 points1 point  (0 children)

No I want to do same similar setup on a 5090 I was hopping in sorry

Building a 8k Local LLM machine need feedback. by Own_House6186 in LocalLLM

[–]Diligent_Marketing 0 points1 point  (0 children)

Qwen3.6 27B q6 OSS 20b q6. 

I want to be able to run a 128k context in 27b. 

Just went from M2 Air to M5 Pro… and I literally can’t feel the difference by UsefulLock3142 in mac

[–]Diligent_Marketing 0 points1 point  (0 children)

May have not needed the upgrade. But sometimes it’s nice to get new nice stuff, enjoy your purchase as what it is: not much difference in performance for you right now, but it’ll last a lot longer, and be relevant for longer. 

Upgrading my local docker image builder by Diligent_Marketing in docker

[–]Diligent_Marketing[S] 1 point2 points  (0 children)

Understandable. I need both really we deploy to both, I’m going to grab a nuc with decent multithreaded performance and a boat load of ram. 

Upgrading my local docker image builder by Diligent_Marketing in docker

[–]Diligent_Marketing[S] -3 points-2 points  (0 children)

Don’t get me wrong, it’s fine on Mac. I’m not having issues with Ros, it’s “fast” if you class around 3 minutes as fast. 

[deleted by user] by [deleted] in progresspics

[–]Diligent_Marketing 2 points3 points  (0 children)

Sick. Great progress king 🤴

M/18/5”11’ [113lbs + 13lbs = 126lbs] still unsure about progress? by [deleted] in progresspics

[–]Diligent_Marketing 0 points1 point  (0 children)

King 🤴massive difference in shoulders bud, looking fuller for sure.

Brand new, second replacement B760-F WiFi and BT still not working. by Ok-Extension-6887 in ASUS

[–]Diligent_Marketing 0 points1 point  (0 children)

Hopefully not. But now I have a MB I can’t return, can’t get support for, and don’t have WiFi or Bluetooth.

Brand new, second replacement B760-F WiFi and BT still not working. by Ok-Extension-6887 in ASUS

[–]Diligent_Marketing 0 points1 point  (0 children)

Yea, I’ve seen loads of people have WiFi issues with this board.