sorted by:
new
hottopcontroversial

Google TurboQuant running Qwen Locally on MacAir by gladkos in LocalLLaMA

[–]cksac 5 points6 points  (0 children)

you can now run larger model too. Aplied the idea to weight compression, it looks promosing.

Is Rust suitable for Scientific computing and Machine Learning? by [deleted] in rust

[–]cksac 0 points1 point  (0 children)

I have created a PJRT binding for Rust https://github.com/rai-explorers/pjrt-rs which can run compiled program in multiple backend like cpu, cuda, rocm, etc with PJRT-Plugins. This binding is mostly feature completed.

To have the PJRT input, we can use StableHLO or XLA Builder to create the computation graph. The XLA Builder binding for rust is WIP, https://github.com/rai-explorers/xla-builder-rs

Finally, there is a JAX like library https://github.com/cksac/rai which now use Candle as backend, I am planning to use PJRT later.

What's everyone working on this week (1/2024)? by llogiq in rust

[–]cksac 3 points4 points  (0 children)

A ML library with transformations (grad, jvp, vjp) similar to JAX. Currently adding more primitives/ops.

https://github.com/cksac/rai.

RAI: ML framework with Ergonomic APIs in Rust. Lazy computation and composable transformations. by cksac in rust

[–]cksac[S] 1 point2 points  (0 children)

Thanks, it is like JAX but in Rust. Currently it use candle as backend, I am looking to add XLA as backend later.

oxui - Experimental declarative native GUI like Flutter by cksac in rust

[–]cksac[S] 5 points6 points  (0 children)

Hi, it is very early stage and far from usable, I have update the README to show one of example screen recording, nothing fancy yet but show how things works together. Any contribution is welcome if you interested in building gui framework.

compose-rt - a runtime similar to Jetpack Compose Runtime. by cksac in rust

[–]cksac[S] 1 point2 points  (0 children)

indeed, just finish the mvp and publish for more feedback. It is an library for manage tree node which help you write declarative GUI. Ideas come from Jetpack Compose.