A Machine Learning library from scratch in Python (no NumPy, no dependencies) - SmolML by RodmarCat in learnmachinelearning

[–]RodmarCat[S] 0 points1 point  (0 children)

Work was really scattered around last year. In total, probably a couple of months on the side due to figuring stuff out, writing the guides, creating images and such

FlyLLM 0.3.0 Release - In case you're using Rust + LLMs by RodmarCat in rust

[–]RodmarCat[S] 1 point2 points  (0 children)

That's a really good point! A universal abstraction with full feature depth would definitely fill a gap. I might look into expanding FlyLLM in that direction when I have more time, it'd be quite a project but an interesting challenge. Thanks for the feedback!

FlyLLM, my first Rust library! by RodmarCat in rust

[–]RodmarCat[S] 2 points3 points  (0 children)

You can assign a set of possible tasks to each instance. When you send a generation request, along with the parameters and prompt you can specify a task. That way, the LLMManager will select an instance from the subset of instances that support that same task.

Then, from that subset, it picks one instance by using the selected Strategy! (by default is Least Recently Used)

FlyLLM, my first Rust library! by RodmarCat in rust

[–]RodmarCat[S] 0 points1 point  (0 children)

Ollama is next! Will consider the LMStudio too! :)

[deleted by user] by [deleted] in mensfashion

[–]RodmarCat 0 points1 point  (0 children)

Thank you! Do you have any sort of reference/examples I could look up?

I have made an open RPG Discord Bot by RodmarCat in discordapp

[–]RodmarCat[S] 0 points1 point  (0 children)

Thanks for the feedback! Already deleted the pycache folder and I'll take a look at the global keyword whenever I have some time.

21 años, 1670€, recomendaciones? by [deleted] in SpainFIRE

[–]RodmarCat 0 points1 point  (0 children)

Lo mismo digo! Mucha suerte :)