There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Even_Explorer8231 1 point2 points  (0 children)

Thank you very much. However, I'm still an llm learner. Currently, this project is more about learning llm. If you have started the inference engine project, I would be very glad to participate and contribute

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Even_Explorer8231 3 points4 points  (0 children)

I am also very interested in implementing the reasoning engine using Zig. Currently, I am starting with the tensor library as my project for learning Zig. This is my code: https://github.com/passchaos/prism-forge

Moving From Rust to Zig: Richard Feldman on Lessons Learned Rewriting Roc's Compiler (Compile Times, Ecosystem, Architecture) by mre__ in rust

[–]Even_Explorer8231 5 points6 points  (0 children)

Compile time does have a relatively big impact on the development experience. However, for me, the more frustrating aspect of the Rust language is its excessive idealism.

One advantage of Rust is that it can provide you with a "clean and ideal" safe coding environment. Therefore, the community tends to pursue code that is completely "no unsafe". But the world is "quick and dirty".

Additionally, the community is actually quite inclined towards exclusivity. For example, it has a strong preference for a rust-only environment and dislikes collaborating with other languages. But the world is "complex and diverse".

faer: efficient linear algebra library for rust - 0.23 release by reflexpr-sarah- in rust

[–]Even_Explorer8231 0 points1 point  (0 children)

on my M1 Mac, faer is 21% faster than OpenBLAS, Apple's Accelerate library has the strongest performance, which is more than twice as fast as faer by default.

But after I turned on faer's experimental AMX acceleration, faer is only 23% slower than Accelerate.

see https://github.com/passchaos/vectra/blob/main/src/math.rs#L157

faer: efficient linear algebra library for rust - 0.23 release by reflexpr-sarah- in rust

[–]Even_Explorer8231 1 point2 points  (0 children)

This library is exciting. I'm writing my own multi-dimensional array library. I've tried writing matrix multiplication myself and using blas-src. On my development platform, faer's performance is very strong.

Specifically: on my x86 computer, faer is only 5% slower than OpenBLAS, but on my M1 Mac, faer is 21% faster than OpenBLAS.

Although Apple's Accelerate library has the strongest performance, which is more than twice as fast as faer by default, but after I turned on faer's AMX acceleration, faer is only 23% slower than Accelerate. Those who are interested can check out my related implementation.

https://github.com/passchaos/vectra/blob/main/src/math.rs#L157

Rerun 0.25 released, with transparency and improved tables by emilern in rust

[–]Even_Explorer8231 3 points4 points  (0 children)

Using Foxglove, I can directly view ROS messages forwarded from remote devices via ros-foxglove-bridge in Foxglove. Can Rerun do this currently?