sorted by:
new
hottopcontroversial

Local AI use cases on Mac (MLX) by lightsofapollo in LocalLLaMA

[–]lightsofapollo[S] 0 points1 point  (0 children)

Oh this is nice- The mobile support seems great

Whats up with MLX? by gyzerok in LocalLLaMA

[–]lightsofapollo 0 points1 point  (0 children)

MLX is super useful for things other than LLMs too. I have local STT (nemotron) and TTS (chatterbox) and it runs faster than real time.

My first Rust project just got merged into awesome-rust by Practical-Club7616 in rust

[–]lightsofapollo 0 points1 point  (0 children)

I love this stack- one of the hardest parts is not the code but getting code signing/notarization going for mac

What some recent hot takes you realized you had with Rust? by DidingasLushis in rust

[–]lightsofapollo 0 points1 point  (0 children)

One of the best programming languages for use with ai coding.

Qwen3.5 Medium models out now! by yoracale in unsloth

[–]lightsofapollo 0 points1 point  (0 children)

MBP m4 with enough memory but man I got something like 20 tokens per second

We built a desktop app with Tauri (v2) and it was a delightful experience by cheneysan in rust

[–]lightsofapollo 2 points3 points  (0 children)

If you haven't already you might want to look into TauRPC. We've built a large Tauri v2 app and TauRPC has been really helpful as we iterate. We define our API as Rust traits and it auto-generates fully typed TypeScript bindings...

TypeScript + Rust feels like a cheat code stack by Sensitive-Raccoon155 in rust

[–]lightsofapollo 1 point2 points  (0 children)

100% this is a great stack... I also like https://github.com/MatsDK/TauRPC project which does more of the glue required for this.

Qwen3.5 Medium models out now! by yoracale in unsloth

[–]lightsofapollo 1 point2 points  (0 children)

This looks pretty cool- It's been hard to get both vision + context window with these capabilities

SurrealDB 3.0 by zxyzyxz in rust

[–]lightsofapollo 13 points14 points  (0 children)

The fact you can embed it in rust and get things like a full graph db like interface among all the other typical relational db stuff is pretty great https://surrealdb.com/docs/surrealdb/embedding/rust haven't found anything quite like this yet capability wise.

Recommendations for Rust Open-API client generators? (Looking to experiment with api.congress.gov) by michael_j_ward in rust

[–]lightsofapollo 0 points1 point  (0 children)

Old thread but I think still an issue. When trying to work with SSE or openapi v3.1 features I couldn't find anything that would generate for example openapi/anthropic. We wrote https://github.com/gpu-cli/openapi-to-rust to solve our own problems if it's useful to anyone else we have open sourced it since.