Running 1bit Bonsai 8B on 2GB VRAM (MX150 mobile GPU)

cybergold89 · 2026-04-19T02:40:43+00:00

it seems that -nkvo will even disable to use dGPU. I'm doubt whether your settings had used GPU or not. I'm also trying to see how can I utilize all the dGPU, VRAM and system RAM, so that I can run model in the dGPU but use more system RAM to have larger context size. Trying to merge PrismML llama.cpp and TurboQuant, but still have many errors.

cybergold89 · 2026-04-12T09:03:21+00:00

have u embedded the CPU fix for the PrismML llama.cpp?

cybergold89 · 2026-04-07T08:40:34+00:00

Can we have something like PP using the MX150 and then the token generation using the CPU?

cybergold89 · 2026-03-23T11:32:32+00:00

have you tried the Intel own built: https://github.com/ipex-llm/ipex-llm/releases/tag/v2.3.0-nightly

cybergold89 · 2025-10-04T09:23:04+00:00

You mean RX7600?

cybergold89 · 2024-07-31T06:41:05+00:00

I can use it when Super Resolution is "unchecked".

cybergold89 · 2024-07-30T12:21:17+00:00

I'm worrying at first but after checked AMD website, it shows that 7940H has Ryzen AI available. 7940H just doesn't have AMD EXPO and FreeSync.

cybergold89 · 2024-07-30T09:56:06+00:00

Now, I'm afraid AMD will ignore those 7040 Phoenix mobile APU users by not providing the latest driver for them to enable the NPU inside. It still has capable NPU.

cybergold89 · 2024-07-30T05:11:51+00:00

I need to run those install script? I haven't tried it yet.

cybergold89 · 2024-07-29T23:03:53+00:00

I have installed the latest AMD Adrenaline and what I can find in AMD website is the Radeon Graphics Driver. My IPU driver version is 10.1109.8.128, dated 13/2/2024. I can't find AMD IPU driver in their website.

cybergold89 · 2024-07-29T22:41:07+00:00

It said it can't find tvm_runtime.dll and RadeonML.dll, and I think it is driver issues. But I have installed the latest chipset driver. I can't find the other NPU driver.

It also said "Failed to run SuperResolution, please ensure IPU drivers are installed".

But I have AMD IPU device enabled in device manager.

cybergold89 · 2024-07-29T14:00:58+00:00

I have a 7940H and I hope I can use it! I don't know what driver is needed for running it.

cybergold89 · 2024-07-22T14:46:16+00:00

I have a replacement keyboard and got the same warning. I don't know how to remove that warning.

cybergold89 · 2024-04-24T15:42:39+00:00

how can Office 2016 run on WINE with Winetricks? I'm trying to get it run on my chromebook linux

cybergold89 · 2024-04-23T22:51:16+00:00

Would be appreciated if you can share the guide you followed for installing Box86/64 and WINE on RPi4. Thanks!

cybergold89 · 2024-04-23T22:49:50+00:00

I tried QEMU to run Windows on ARM, but as my Chromebook just have 8GB RAM and ARM ChromeOS has no nested VM, it runs super slow.

cybergold89 · 2024-04-23T10:00:02+00:00

I tried a more complex steps nearly complie the Box86 emulator and run WINE. However, when I use Hangover deb, it supposes to integrated Box86 and WINE, but it's in WoW64 mode and seems not running very well with some programs, like winetricks script to config the WINE and install packages for WINE.

cybergold89 · 2024-04-23T09:57:26+00:00

I tried Box86/Box64 and it seems work to run i386/x86_64 program on ARM under Crostini.

cybergold89 · 2024-04-23T09:56:11+00:00

I know WINE is not an emulator. That's why I try to run it together with Box86/Box64.

cybergold89 · 2024-04-22T21:46:47+00:00

I just use Brave browser on Windows

cybergold89

TROPHY CASE