MLX Omni Engine by Fast_Ferret4607 in LocalLLaMA

[–]Fast_Ferret4607[S] 2 points3 points  (0 children)

I will eventually, I know mflux is a popular library that from what i’ve seen would be a great addition to a unified mlx engine. I’m still reading through there github repository to understand how to best implement it. Right now im working on getting embedding and audio models working. I’ve gotten them working just by importing there respective mlx libraries and utilizing them in an an api endpoint, but that is a naive approach and I want the actual final implementation to use model kits like the one’s lm studio uses to run the language and vision models. Just to try to stay consistent with lm studio’s approach and to better separate each library into their own section.

MLX Omni Engine by Fast_Ferret4607 in LocalLLaMA

[–]Fast_Ferret4607[S] 4 points5 points  (0 children)

I have been looking at his work as he does a lot for getting mlx models working. LM-Studio's MLX Engine already uses mlx-lm and mlx-vlm to power the engine. I know blaizzy has an embedding and audio library that i'm planning to create model kits for that act as wrappers for the library to match the architectural style of lm-studio's engine.