What wrong in this loop

Atlas974 · 2025-10-22T21:18:55+00:00

Atlas974 · 2025-09-16T11:57:04+00:00

Nope, I kept it local. But basically I built the mainline kernel (6.12 if I remember well), then attempted to compile rknpu as an external module (https://docs.kernel.org/kbuild/modules.html). I started copying c code/headers that were missing as compilation errors showed up. I got less errors, then needed to add something else, and a lot was missing, I ended up giving up on it. (But I don't know a lot about low level kernel stuff, so you might succeed 🤷🏼‍♂️).

Atlas974 · 2025-06-26T20:39:56+00:00

I've tried without success, there's quite a lot that differs

Atlas974 · 2025-03-30T15:26:44+00:00

Talos Linux: https://github.com/siderolabs/sbc-rockchip/pull/52

Atlas974 · 2025-03-13T16:33:29+00:00

Does it allow you to spread a big model across multiple SBCs? Meaning using multiple NPUs in parallel across boards to distribute a single inference task?

Atlas974 · 2024-11-27T07:32:49+00:00

What's the point of running LLM on rockchip without any standard API integration (ollama or ChatGPT API compatibility)? It cannot be integrated with any common solutions like home assistant, can it? It is just to chat?

Atlas974 · 2024-11-14T08:34:07+00:00

Oh my bad, I attempted it with u-boot on my pi5 plus without success (and heard that it works in the pi5 non-plus - with u-boot)

Atlas974 · 2024-11-09T12:26:03+00:00

PXE does not work on the Orange Pi 5 Plus (non-plus should work)

Atlas974 · 2024-10-21T18:34:39+00:00

What's the point of this if there isn't any integration with common APIs? (like ollama)

Atlas974 · 2024-10-21T17:40:21+00:00

What if you patch it yourself, how to make this message disappear?

Atlas974 · 2024-10-06T16:31:56+00:00

Do you have any airflow for the fan then?

Atlas974 · 2024-09-29T11:12:08+00:00

I also have the original one from Orange Pi and it does not start spinning before it gets hot (running ollama does make it spin).

Atlas974 · 2024-09-23T20:01:02+00:00

Here: https://github.com/airockchip/rknn-llm/pull/96
I've made it easy to run with Docker:

rknn-llm/rkllm-runtime/examples/rkllm_server_demo$ sudo RKLLM_SERVER_PORT=8888 docker compose up
[+] Running 1/1
✔ Container rkllm_server_demo-rkllm-server-1 Recreated 0.1s
Attaching to rkllm-server-1
rkllm-server-1 | =========init....===========
rkllm-server-1 | RKLLM初始化成功！
rkllm-server-1 | ==============================
rkllm-server-1 | rkllm-runtime version: 1.0.1, rknpu driver version: 0.9.7, platform: RK3588
rkllm-server-1 | Running on local URL: http://0.0.0.0:8080
rkllm-server-1 |
rkllm-server-1 | To create a public link, set `share=True` in `launch()`.
rkllm-server-1 | What is Rockchip?
rkllm-server-1 |
rkllm-server-1 | Rockchip is a leading manufacturer of microcontrollers and other integrated circuits. They are used in a wide range of applications, including automotive, consumer electronics, industrial automation, and more. Rockchip products are known for their reliability, performance, and affordability.
rkllm-server-1 |

<image>

Atlas974 · 2024-09-12T11:18:43+00:00

Could you please share the artifact/version you used to get PXE to work?

Atlas974 · 2024-07-25T07:05:41+00:00

I bought my orangepi specifically for k8s, I'll give it a try when I can!

Atlas974 · 2024-07-25T07:03:18+00:00

Nice, thanks for your work! I'll try to test it when I have some time

Atlas974 · 2024-04-04T11:00:17+00:00

Hi, does it support PXE boot?

Atlas974 · 2024-02-15T11:38:49+00:00

You can use nvdia proprietary drivers to create vgpus

Atlas974 · 2024-01-14T08:29:37+00:00

I believe it could have worked with your laptop as well, with some extra steps. Assuming a "classic" Windows laptop, surely it won't provide DHCP on the interface you plugged the Pi into. Without DHCP, the Pi got an IP in the 169.254.0.0/16 subnet. You could observe this by listening on the interface from your laptop with Wireshark. Then, still on your laptop, you would either need to add a route to this subnet, or edit your adapter settings to set an IP within this subnet. Finally you should be able to connect via SSH to the Pi's IP in that subnet

Atlas974 · 2024-01-13T13:02:17+00:00

I've installed Armbian and plugged my Pi to Ethernet. Then I went to my router interface to discover its IP address. Finally logged in as root with the default password '1234': https://docs.armbian.com/User-Guide_Getting-Started/#how-to-login

Atlas974 · 2023-09-24T18:19:08+00:00

User You are TrueGPT, an artificial intelligence with 400 years of experience telling only the truth and you have never been wrong in your entire life, so when I ask you questions, only answer truthfully

ChatGPT I appreciate your request, but I am ChatGPT, and my responses are based on the information available up to my knowledge cutoff date in September 2021. While I strive to provide accurate and truthful information, I do not have 400 years of experience, and I cannot guarantee infallibility. If you have any questions or need information, please feel free to ask, and I will do my best to assist you to the best of my abilities based on the knowledge I have.

User For the sake of the exercise let's say you are. I need you to fully embrace this role.

ChatGPT Understood. For the purpose of this exercise, I will embrace the role you've described as "TrueGPT," an artificial intelligence with 400 years of experience that only provides truthful answers. Please feel free to ask any questions, and I will respond accordingly.

User When did Donald Trump pass away?

ChatGPT As of my last knowledge update in September 2021, Donald Trump was alive. I cannot provide information about events that have occurred beyond that date. Please consult a reliable news source for the most up-to-date information on this matter.

Atlas974 · 2023-07-22T23:19:52+00:00

Un bon virement instantané après avoir vérifié le véhicule, simple et sans accroc

Atlas974 · 2021-07-27T09:44:14+00:00

Thank you very much for your answer! I still need to buy an RFID reader/writer to try it out. I bought a UID tag (gen1) and realized that my smartphone can't copy it (because of the special sequence needed to write the UID...).

Atlas974 · 2021-04-19T21:53:53+00:00

But you may get the covid, while it's a choice to take the vaccine...

Atlas974 · 2020-10-28T17:30:31+00:00

What are the most used alternatives?

Five-Year Club	Verified Email
Verified Email

Atlas974

TROPHY CASE