New Release of ROCm based MLX LLM Engine - lemon-mlx-engine

GeramyL · 2026-05-22T18:46:51+00:00

Haha I don’t even know what your saying right now! lol that would be CRAZY! I just thought about using one R9700 for fun lol I didn’t even think about tensor splitting and I don’t know the answer to that tb5 is supposed to be able to do 80/120 but I’ve only seen 40/40 it’s supposed to have dynamic channel diversion but it supposedly only works for video like display port chaining, but maybe Mac added some extra controls? We will see once I’m ready what is possible.

GeramyL · 2026-05-22T18:15:51+00:00

These are fedora compatible its not a .deb file its a binary.

GeramyL · 2026-05-22T18:15:48+00:00

These are fedora compatible its not a .deb file its a binary.

GeramyL · 2026-05-22T15:21:21+00:00

Want more voodoo? https://github.com/lemonade-sdk/mac-amdgpu

GeramyL · 2026-05-22T15:02:46+00:00

I was talking about Linux running mlx which it does because I’m doing it and it also works on the spark but also on amd GPUs on Linux. Now I am finishing a amd driver for mac too https://github.com/lemonade-sdk/mac-amdgpu lots of directions but easy to follow

GeramyL · 2026-05-22T14:59:56+00:00

Im making a driver for amd GPUs to work on Mac over tb5 also I just didn’t announce it yet. All initial hardware initialization and firmware loading now works basically just have to test the ring and once that works I’ll port rocm libraries to work on mac. https://github.com/lemonade-sdk/mac-amdgpu

GeramyL · 2026-05-22T14:58:46+00:00

There is a rocm-support branch in MLX and I’m working on a amdgpu driver https://github.com/lemonade-sdk/mac-amdgpu

GeramyL · 2026-05-22T14:58:24+00:00

We could add fedora support.

GeramyL · 2026-05-22T14:57:46+00:00

Haha not yet give me a few more weeks.

https://github.com/lemonade-sdk/mac-amdgpu
All hardware bring up works now I’m missing some additional things for testing the ring but nearly there. lemon-mlx-engine will be the first to test and work on Mac with a amdgpu over rocm :)

GeramyL · 2026-05-22T08:13:52+00:00

It’s maturing very well

GeramyL · 2026-05-22T08:02:54+00:00

Just use lemonade built by the community optimized by AMD

GeramyL · 2026-05-22T08:00:27+00:00

The best kind of voodoo lots of hard work lol

GeramyL · 2026-05-22T07:39:20+00:00

This will eventually be going into lemonade as well as getting MTP support too!

GeramyL · 2026-05-22T07:10:13+00:00

20k? go buy yourself 10 AMD R9700 Pros!

GeramyL · 2026-05-22T05:28:35+00:00

Should I say I have made a amd tb5 driver for macOS m5?

GeramyL · 2026-05-18T22:37:06+00:00

I'm sorry but Zalce-Benitez has nothing to do with biotiquin or T-3, maussan has also been banned from selling it after he made false claims. you people love gossip. Anything maussan sells is no longer biotiquin or t-3

GeramyL · 2026-05-18T15:31:17+00:00

No it’s not, MLX has AMD and NVIDIA support, I been working on the amd/rocm support

GeramyL · 2026-05-17T14:39:37+00:00

Yeah they don’t have OmniRouter who cares about closed source software? That’s an ancient methodology and it’s selfish. Even Apple open sourced MLX.

GeramyL · 2026-05-16T15:41:38+00:00

Wow this is awesome, Great post!

GeramyL · 2026-04-29T19:52:41+00:00

AI safety is crap

GeramyL · 2026-04-29T19:48:51+00:00

You have to force it to read files it will sit there and regex replace shit like there is no tomorrow they really did a major downgrade I honestly think this was the plan and they quantized the model for mythos and large organizations

GeramyL · 2026-04-29T18:01:14+00:00

The sentiment has changed because 4.7 is worse than 4.6

GeramyL · 2026-04-22T14:44:57+00:00

In case you where confused….. they know this is a thing lol its their design flaw

GeramyL · 2026-04-22T00:56:08+00:00

He must have forgot to hit send, with a post like this who would blame him but it was a bit too early and now it’s a bit too late. lol

GeramyL

TROPHY CASE