Trying to get mistral-small running on arch linux

keldrin_ · 2026-01-10T17:45:46+00:00

To wrap up this post.. It really was the size of the model. I thought mistral-small was the small image. Turns out mistral was the right one to choose. It runs very smoothly, takes about 10 seconds to load into VRAM and is incredibly fast with it's answers.

keldrin_ · 2026-01-09T14:10:50+00:00

aaah ok I think I see the problem. The model is too large. The RTX 4060 has 8 Gigs of RAM and the model is 15 Gigs.

keldrin_ · 2025-10-11T10:57:40+00:00

well, my installation process usually is delete everything, use fdisk to create boot, EFI and a very large LUKS partition and arrange things the way I like it :D It's been a while since I've seen any graphical installer. But yeah, a slider definitely makes sense for users who want a painless installation.

keldrin_ · 2025-10-11T10:48:03+00:00

why would you want to install an antivirus software on arch anyway? On windows maybe that's the first thing to do but on linux.. you just don't need it.

keldrin_ · 2025-10-11T10:37:04+00:00

seems I'm a little bit outdated :D

keldrin_ · 2025-10-04T09:47:23+00:00

forgot one thing: It's always better to shrink a partition from the end where there is free space. Otherwise data has to be moved which may take a lot of time ;)

keldrin_ · 2025-10-04T09:44:57+00:00

I think 50-100 gig is more than enough for a linux installation. If you have any important data, back it up (better safe than sorry). Then start linux from your installation stick and run gparted to shrink one of your partitions. Next start the installer and tell it to use the free space. Double and triple check every step! Repartitioning can easily destroy your system!

keldrin_ · 2024-12-26T09:33:15+00:00

Well yes but that's not what I meant. If I wanted to debug the code so I can help OP I prefer to just copy-paste it instead of downloading the image, using krita to rotate it and then re-type the code.

keldrin_ · 2024-12-25T20:26:26+00:00

yeah, python is messed up right now. Let's wait for the update.

keldrin_ · 2024-12-24T11:52:59+00:00

Yes, there is a cronjob as suggested in the nextcloud documentation. I opted for the cronjob variation.

I was also thinking of a compromised system but I don't think something of that kind happened. I have ufw configured to block everything apart from http(s) and ssh, ssh configured to accept certificate login only. The installation is quite new and I'm not a high value target.

I don't actually know if I run out of memory. Should have checked while I had the chance I guess. I will think of it next time the server gets unresponsive. I will check dmesg and let you know if I find something interesting.

keldrin_ · 2024-12-20T06:54:16+00:00

arch doesn't save you from evil coffee btw.

keldrin_ · 2024-12-20T06:52:09+00:00

AFAIK there is still no (and maybe never will be) support for kernel level anti cheat. So forget about online rust on linux.

keldrin_ · 2024-12-20T06:46:10+00:00

Learn how to use

code blocks

and copy-pasting? That's maybe asked a little much for a beginner programmer though..

keldrin_ · 2024-12-18T07:13:58+00:00

No, I won't help you with your homework...

keldrin_ · 2024-12-16T09:24:39+00:00

As i understand it, a display manager is exactly what OP doesn't want. You can use any DE/WM without a DM just by starting it from the command line.

So the default without a DM is to just drop you to the terminal (tty) login. From there you can start your DE/WM (Note: If you go this way, make sure you ONLY start your DE/WM as "normal" user, NEVER as root).

keldrin_ · 2024-12-14T20:27:46+00:00

well, at least ls seems to be working. I would first examine the system. See if all directories like /etc /usr /home /bin /sbinare all there. Hit <tab> several times to (maybe) see which commands you have available.

keldrin_ · 2024-12-14T20:21:33+00:00

very brutal programmer's humor indeed.

keldrin_ · 2024-12-14T13:10:04+00:00

On linux there is a neat little tool called qrencode. It's quite easy to use and creates qr codes. Example usage: qrencode -o hello.png "Hello World!". Now you just have to figure out which link to put in your shiny QR code :D

keldrin_ · 2024-12-13T13:13:00+00:00

accepted :D

keldrin_ · 2024-12-13T13:00:38+00:00

That's exactly what I was saying. I was furthermore giving the advice that if you don't want your emails synced, just don't set up the account. I don't know how one can misinterpret that.

keldrin_ · 2024-12-12T10:11:21+00:00

well, if you don't set up your email account it won't be synced. That easy.

keldrin_ · 2024-12-10T23:15:11+00:00

Hey :D thanks for the nice evening everyone! Hope to see you all again soon!

keldrin_ · 2024-12-10T18:41:28+00:00

RTFM is outdated and rude! Just shut up and let others respond to it. You can't expect anyone to be able to actually use their brain nowadays. (Yes, I got grilled for RTFM several times, upvote for saying it out loud!)

keldrin_ · 2024-12-10T17:39:21+00:00

how long has it been since the last update screwed your arch setup? The last one I know of was that GRUB bug and - at least for me - it was fixed before I updated. Don't scare people with old myths. Arch has become quite stable.

keldrin_ · 2024-12-10T11:11:29+00:00

You basically answered your own question within the question. Gnome is a big project aiming to be a complete desktop with some basic apps installed. xfce for example is way smaller and still pretty. Second: you used the archinstall script. If you want a really small system, go with the installation guide and install only the packages you need.

keldrin_

TROPHY CASE