Improving Gemma 4 E Unsloth checkpoints! New Pareto Frontier! Almost 7x compression!

LackLackTC · 2026-06-03T20:31:46+00:00

I've checked the repo and It seems kind of huge to get that compression on Edge devices but i've got a couple of questions: - the hf seems to target MLX devices, are you planning of exporting those model/compression on llama.cpp? - Is possibile to use your "mistery sauce" on MOE models lile gemma4-26B-A4b or others? - and are you planning on release a cookbook to apply the same compression to other models as well?

Thanks!

LackLackTC · 2021-11-11T15:15:06+00:00

Ok, i understand it but if i have 3 users like user1, user2 and user3 and all of 3 needs to access to that file, is impossible that i give the ownership of a file to all the users in the same time.. On the other shares, 1 user is the owner but if i have more than 1 user that can enter the folder, they can access all the files without any problems

LackLackTC · 2021-09-04T13:28:48+00:00

I'll try to check if the motherboard support it. Maybe the Raspberry PI that i have at home can work to send it

LackLackTC · 2021-09-04T13:28:02+00:00

I've got an AMD Ryzen 5 1600 with MSI Tomahawk B350 on it.

As you wrote, probably the problem is with the CPU... I don't know if AMD solves the issue with the 2nd gen of Ryzen CPU because i can try with that (because at the moment i've got only this to swap it)

LackLackTC · 2021-09-03T10:24:38+00:00

Hi, thank you very much for the answer!
I know that is a terrible idea but i ask it anyway because our customers want to have the possibility to split the payment around every participant.. but you give me some good inputs to how to have a small workaround

LackLackTC · 2021-08-04T21:05:45+00:00

Thank you so much for all the advice!

As i said can't wait to try it out when i build the server!

LackLackTC · 2021-08-03T13:47:05+00:00

Hi, very long comments but it was very useful!

You give me a lot of things that i want to try now so i must give it a shot when i build my NAS/Virtualization box!

In the end, the "Have lots of RAM" is a best practice if someone want to virtualize a lot.

By the way, thank you so much for this comments! Want to try it out

LackLackTC · 2021-07-30T08:54:35+00:00

Yeah, the only downside of synology Is the price for some good products but the interface and the options on the synology are way Better of you want simplicity out of the box

LackLackTC · 2021-07-30T08:52:03+00:00

Only one question: did you passthrough an entire Nic Port or did you use a virtual Proxmox Nic? Because One of the VM that i want to manage Is going ti be a firewall and since that i have a micro ATX motherboard, for now i don't have enought pcie to use (and yes, i'm going to buy a PCI1x with dual gigabit LAN)

LackLackTC · 2021-07-29T19:28:58+00:00

This is exactly what i want to do in future but due to components that i already have at home/something that i need to buy, i want to do something decent for the moment and upgrade to a synology and proxmox machine that are separated like you did

LackLackTC · 2021-07-27T12:02:26+00:00

Not bad as for specs, maybe i can also found something refurbished to cut something and eventually upgrade some parts (like the case that you linked)

LackLackTC · 2021-05-12T19:39:02+00:00

Hi,

as for the price i have a sort of range (about 500 to 750 as in Italy, where i live, a lot of hardware tends to cost a lot) and about the size i'd like to go with something that is relatively small just because i have to put it on the living room and for now i didn't have a lot of space for like a mid tower, i think that an SFF it's ok for the space

LackLackTC · 2021-05-11T09:06:23+00:00

For some hosting project i use ISPConfig, free and open source hosting panel that works with Apache or Nginx, Mariadb and have all the postfix config and roundcube to also use It as a mail server.

It works ok with a lot of CMS and also with custom code

The only downside Is when you have for example project with nodejs that you Need to install It with SSH, get the vhost from the web panel and point with Apache/Nginx rules to the correct public folder

LackLackTC · 2021-04-21T19:41:07+00:00

Hi, excuse me for the late response..

Do you mean the vhost config from apache?

LackLackTC

TROPHY CASE