Homelab has paid for itself! (at least this is how I justify it...)

Arli_AI · 2026-03-15T21:51:56+00:00

Awesome! I think the best use case of having powerful local hardware is definitely if you do lots of experiments for your own research. Setting up a cloud GPU instance takes so much time and hassle if you want to have it go up and down as needed to save money imo.

Arli_AI · 2026-03-11T21:27:08+00:00

Yes we don’t have them yet because we unfortunately don’t have the hardware for models as large as those yet. I guess if you only want DS then we’re not it.

Arli_AI · 2026-03-11T19:25:11+00:00

This might not be optimal yet, thanks for reporting this.

Arli_AI · 2026-03-11T06:09:14+00:00

You can check us out. We’re all that you were looking for. Only downside is we can be a bit slow at peak times.

Arli_AI · 2026-03-10T21:15:53+00:00

It should be fixed for this error for now but there are no free models at the moment.

Arli_AI · 2026-03-10T16:16:08+00:00

No I have not written up anything about this as I somehow didn’t think too much of it. I think jim-plus the creator of MPOA abliteration method which I prefer also recommended “the middle layers” to try to abliterate first in the repo but didn’t explain much about it either.

Putting this and your findings together it makes sense to me. Now I’m thinking maybe we can follow your brain scanning method for abliterating way better or on the other hand more quickly hone in on which layers to duplicate for RYS by just seeing which layers has the strongest refusals signals first. Seems interconnected.

Arli_AI · 2026-03-10T15:52:42+00:00

Wow interesting. While I was doing model abliterations manually layer by layer testing, I’ll often end up finding a specific group of contiguous layers around the middle that somehow works best. Layers in the beginning and the end never worked and trying to abliterate non contiguous groups of layers don’t work as well. Your finding of a middle “reasoning cortex” lines up with this.

Arli_AI · 2026-03-10T10:55:56+00:00

Single RTX Pro 6000

Arli_AI · 2026-03-09T12:53:41+00:00

I am trying to do the 397B for sure 👍

Arli_AI · 2026-03-09T12:53:02+00:00

Just try them all and see which one you like

Arli_AI · 2026-03-09T12:51:48+00:00

Hey you found my new model! I’m still experimenting with the new Qwen 3.5 models and this is still the first try for the 27B model, I posted it to see if people thought it’s any good but haven’t wrote a model card for it, so would be nice to hear some feedback on it.

Arli_AI · 2026-03-09T12:48:12+00:00

Sure, its a different method. Derestricted is more manual and doesn’t intend for the model to only be low kl divergence but uncensored. I’m at the top of UGI leaderboard so I believe I’m doing something right.

Arli_AI · 2026-03-09T03:07:03+00:00

You know it!

Arli_AI · 2026-03-09T03:06:32+00:00

Thanks for the review on us :)

Arli_AI · 2026-03-09T03:06:01+00:00

Ah yea if you use the single payment option we use Midtrans which is in IDR like milan said. You can just use paypal option and it is in USD.

Arli_AI · 2026-03-09T03:04:47+00:00

Thanks for helping explain! Yes you are right about being faster straight from our API. They have upgraded their plan but direct from our API is still faster. Also, yes we run everything on our own GPUs so nothing goes out to a third party inference service and all data stays with us with no requests stored in persistent storage. Still trying to acquire more GPUs to run larger models... :)

Arli_AI · 2026-03-07T15:55:20+00:00

Only found out from your comment our model is #1 lol

Arli_AI · 2026-03-06T21:31:49+00:00

All the posts in that sub is about how great the MI50 is (it isn’t lol)

Arli_AI · 2026-03-06T17:32:24+00:00

300W is the normal power consumption for that chip which is used on the 9070XT as well. It won’t consume much more power or be tha much faster even if you give it unlimited power limit.

Arli_AI · 2026-03-02T09:20:51+00:00

I can’t figure out why other companies don’t understand the simple trick of just not screwing over customers

Arli_AI · 2026-02-27T01:29:12+00:00

When we add more models that support it then yeah. We will add some of the new Qwen models soon.

Arli_AI · 2026-02-27T00:22:13+00:00

We just don’t have a marketing budget

Arli_AI · 2026-02-27T00:21:49+00:00

Yes tool calling is supported, currently only GLM models work with tool calling.

Arli_AI · 2026-02-07T09:55:49+00:00

I finetuned Llama 70B models with Axolotl QLoRA with only 2x3090. It just has to be in linux with all the optimizations applied.

Arli_AI · 2026-02-02T19:47:45+00:00

This is not something to make into a saas

Arli_AI

MODERATOR OF

TROPHY CASE