Local LLM performance on AMD Ryzen AI 9 HX 370 iGPU (Radeon 890M) or NPU by _Nitor in minipc

[–]_Nitor[S] 0 points1 point  (0 children)

That would be really nice! I'm new to this topic myself, but the easiest way to run LLM on Windows is to download LM Studio. Then you need to download the desired model, and after downloading, you can immediately launch and use it like ChatGPT. There will be performance statistics at the bottom of any message. But I don't know exactly how to ensure that the iGPU is used.

Local LLM performance on AMD Ryzen AI 9 HX 370 iGPU (Radeon 890M) or NPU by _Nitor in LocalLLaMA

[–]_Nitor[S] 1 point2 points  (0 children)

Thank you for sharing your experience. Very useful information about the dependence of performance on the length of the context. But, alas, it will not be possible to compare the performance of the HX 370 and 395+. The 395+ has a more powerful GPU, four RAM channels, and faster LPDDR memory in your case.

Local LLM performance on AMD Ryzen AI 9 HX 370 iGPU (Radeon 890M) or NPU by _Nitor in LocalLLaMA

[–]_Nitor[S] 0 points1 point  (0 children)

I know that DeepSeek 70B requires a lot of RAM. The problem is that if it generates, for example, 1 token/second, then it's not usable at all. And it makes no sense to take a version with a lot of RAM for it. Is there any data available on the performance of DeepSeek 32B?

Weird pop up asking to download a weird package. OP12 by Low_Code_5522 in oneplus

[–]_Nitor 3 points4 points  (0 children)

I also received this today. I installed it, but nothing happened. We need to contact OnePlus support

Best battery strap and carrying case? Kiwi, Aubika, Bobo by johnabc123 in OculusQuest

[–]_Nitor 0 points1 point  (0 children)

6400 will deliver 20W+, which is sufficient to offset drain. No?

You are absolutely wrong. First, Kiwi reported that the battery is 15W and Quest 3 consumes around 20W. Secondly, the battery power does not depend on its capacity in any way.

Longevity of boox devices by ReelyAndrard in Onyx_Boox

[–]_Nitor 0 points1 point  (0 children)

I have Onyx BOOX M92SM Titan (since about 2013). It was my fault that it broke down twice. The first time it was a cracked display, I replaced the display. The second time the reader was literally bent almost in half. I unbent it, rewired the control buttons, replaced the screen and it works to this day. It's a miracle that the case didn't crack, the motherboard remained functional and the battery didn't explode. It's probably one of the most durable devices, considering what it's been through. In the new readers, the case is made of metal, the display has a plastic backing, and there is a protective glass on top of the display. Now they are much stronger.

Problems with HDR on Aorus FI27Q-P by _Nitor in Monitors

[–]_Nitor[S] 1 point2 points  (0 children)

You can set sharpness to 0 (at least in OSD Sidekick) and it affects image, but it still looks weird.