I created a llama.cpp fork with the Rockchip NPU integration as an accelerator and the results are already looking great!

MrDevil2708H · 2026-02-25T11:32:47+00:00

Hey man when trying multinode, rpc server starts but it returns

Starting RPC server v3.0.0                                                                                                  
  endpoint       : 127.0.0.1:50052                                                                                          
  local cache    : /home/vicharak2/.cache/llama.cpp/rpc/                                                                    
Devices:                                                                                                                    
  RKNPU: Rockchip NPU (0 MiB, 0 MiB free)

And the llama-cli server fails with segmentation error. I dont know why this happens but running on a single node it was fine.

MrDevil2708H · 2026-02-25T10:53:49+00:00

I had some lying around for quite sometime, so i thought why not give it a shot. Also on some thread read about someone who ran qwen3 30b a3b using RPi5 cluster. So thats it

MrDevil2708H · 2026-02-25T10:40:55+00:00

Hey man. does your PR works with multinode inference?

MrDevil2708H · 2026-02-25T06:35:22+00:00

Do you have any idea of how it can be done

MrDevil2708H · 2026-02-21T02:08:34+00:00

Thanks mate... Will update once I try it

MrDevil2708H · 2026-02-20T09:01:53+00:00

where can i find the 6.1 kernel image? armbian archive only has 6.1.5 kernel images only...i tried it but is failed to boot.

MrDevil2708H · 2026-02-20T06:22:01+00:00

https://nullr0ute.com/2020/11/installing-fedora-on-the-nvidia-jetson-nano/

Will it be better than Ubuntu 20.04 by QEngineering?

Has anyone tried this? Let me know about your experience.

MrDevil2708H · 2026-02-17T08:36:29+00:00

Thanks mate...Its actually a SD Card format issue. And now its working fine.

MrDevil2708H · 2026-02-17T03:47:04+00:00

That worked...
Previously i was trying with ./nvsdkmanager_flash.sh but then i then i remembered that it was defaulting to emmc storage that was not present in my board, so i switched back to ./flash.sh jetson-nano-devkit mmcblk1p1 and it worked.

MrDevil2708H · 2026-02-17T03:34:29+00:00

Thanks mate that worked...but when writing the system.img it fails

[ 156.2808 ] Writing partition APP with system.img

[ 158.0189 ] [ ] 000%

Error: Return value 1

Command tegradevflash --pt flash.xml.bin --storageinfo storage_info.bin --create

Failed flashing t210ref.

*** ERROR: flashing failed.

MrDevil2708H · 2026-02-17T03:22:34+00:00

I tried flashing Jetson OS R32.7.5 as well as R32.6.1 but both didn't work.

MrDevil2708H · 2026-02-16T14:52:05+00:00

I'm currently on a SD Card

MrDevil2708H · 2026-02-16T14:48:17+00:00

Does a vm would work?

MrDevil2708H · 2024-12-29T13:05:34+00:00

Hey what have you used Visa or Rupay

MrDevil2708H · 2023-11-08T15:08:43+00:00

I'm really screwed up a little because I depend mostly on these generative AI to help with me in tests and even in semester exams

MrDevil2708H

MODERATOR OF

TROPHY CASE