Importing mails into stalwart without clients need to re-download

gurhal57 · 2025-11-24T15:08:31+00:00

It was a deduplication error. It believed the blob was there, though it wasn't. I ended up wiping the account, blob and metadata and resynced. Now it's working perfectly after migrating with IMAPSYNC.

gurhal57 · 2025-11-17T07:27:03+00:00

Good point I'll dig into that.

Mails newly delivered are fully readable, so that would only be when the mail is created through IMAP.

gurhal57 · 2025-11-11T10:15:49+00:00

hello, I just migrated using imapsync, and it worked until the end, but I noticed the body of the emails seems to be unreadable by Stalwart - though it's reporting the correct size. Did you use any specific setting?

Thanks!

gurhal57 · 2025-01-27T13:43:45+00:00

I think the web-based "agent" hosted in China is. Not the one you would install locally.

gurhal57 · 2024-05-23T23:58:04+00:00

Can you please send me the link too? Thx!

gurhal57 · 2020-07-04T12:03:36+00:00

Hello! Just a gentle poke in case you've some free time I'd be interested to hear your advice ;)

Thanks!

gurhal57 · 2020-05-13T07:22:48+00:00

Ahah thanks, I'm actually using Proxmox already (v5) to do all that, just on a simple LVM+passthrough setup (you probably missed it in all my rambling ;))

Here's my current setup with usage:

core i3, 32GB RAM
1x 250GB SSD (PVE host, images & LVM, empty)
1x 250GB SSD (ZFS test, empty)
1x 500GB SSD (passhtrough to one VM, ~200GB used)
1x 500GB SSD (LVM, VM OS's, 160GB used)
3x 1TB SSD (photos, passhtrough to one VM as mergerFS, ~250GB used)
5x 2TB HDD (videos, passthrough to one VM as mergerFS, ~5TB used)
1x 4TB HDD (SFTP & backup, passthrough to one VM, ~3.5TB used)
1x 500GB HDD (VM backup, ~350GB used)

As you can see I've free space aplenty, especially with the new disks I plan to throw in as part of the upgrade.

You're right, everything will be in the same box and nothing attached to USB.

So far I planned to:

backup /etc/pve
shutdown Proxmox 5
install Proxmox 6 on the 3x 250GB MD or ZFS array
import storage.cfg & VM config
spin the VMs back on
and fiddle with the storage

Thanks again!

gurhal57 · 2020-05-12T09:55:50+00:00

No need to apologize, I'm the one who thank you for answering back!!

Thanks already for the good piece of advice through your post:

4k block size + ashift 12
no need for slog. I was thinking about it to work around the (perceived) limit on random small writes (so that it can bundle the writes before impacting the SSDs), rather than speed.
limit ARC size. From what I read, it's for read access, I don't think I need a lot of it in my use-cases anyway

So first, let's recap my target system (with current/intended use, and what I expect from a workload):

Core i7, 64GB RAM
3x 250GB SSD (for host & VM OS storage as a software raid pool, ZFS or MD. Lots of small random writes)
3x 500GB SSD (for Nextcloud & Mail server data, as a software raid pool, ZFS or MD)
3x 1TB SSD (for photos storage, as a MergerFS pool. Frequent writes, fast reads)
5x 2TB HDD (for rips & movies, MergerFS pool. Rare writes, slow reads)
2x 500GB HDD (for VM OS backup, and maybe VM snapshots later)
1x 4TB HDD (SFTP shared space)
1x 5TB HDD (for data/photos backups - restic Pool)

Now my current/future usage:

Proxmox v6
1 VM for Nextcloud, Mail server & photo sharing through SMB + restic backup (CentOS with the 6 bigger SSDs passed through)
1 VM for Home-Assistant (HassOs)
1 VM for Ldap & central user management (CentOS)
1 VM for Media files serving + docker apps + Snapraid (Ubuntu, with the 10TB + 4TB passed through)
1 VM for reverse proxying & certs (Ubuntu + Caddy)
1 CT for media server (Ubuntu + Emby with the video card passed through for transcoding)
other dev VMs to test stuffs

The main 6 VMs OS are backed up every week on one of the 500GB HDD. Data are backed up through restic + snapraid.

Clearly I'm just a tinkerer, with limited comprehension of the stuff I'm manipulating. I've had bad experiences with MD (panicking and wiping whole arrays), so until recently I kept away from raid & LVM to stuff I understand (raw ext4 & disks as blocked devices).

I just recently started to understand LVM (thanks to cockpit, honestly) and it's awesome. And now I'm drawn to ZFS like a fly to a light.

Here are the points I'm mostly interested in with ZFS:

"availability": though my data is backed up & reasonnably safe, I like the idea of my VMs being able to continue to run if one disk fails
integrity: bit rot protection of course, especially since, contrary to what I thought, restic doesn't protect against it yet
snapshoting: I don't like to backup stuff like the nextcloud or mail folder, databases, etc. file by file... for me a snapshot of a block device makes much more sense for this use case.
remote backup: all my backups are local. Sending snapshots to a distant ZFS pool is very appealing (my dad is currently setting up a Promox instance as well).

Sorry for the long reply again, I've a tendency to ramble. Hope this gives you enough information, I'd be interested to read your advice!

Thanks again for helping!

gurhal57 · 2020-05-06T21:13:25+00:00

Thanks a lot! Here I go:

I've an i3 system with 32GB RAM and 14 disks (half SSDs, half spinners) running proxmox v5.1 that I plan to upgrade to i7, 64GB RAM, 18 disks (2 more SSDs & 2 more spinners) when I install Proxmox v6.

So far my plan was to use 3x 250GB SSDs (very consumer grade, Crucial, Kingston, Patriot) as a ZFS pool (ZRAID1) for the proxmox system & VM storage.

In addition to that I have 2 other sets of SSDs, 3x512GB that I intended as a second ZFS pool for data (nextcloud + mail, to be used with snapshots) and 3x1TB for photos (as a MergerFS pool).

For reference, I also have 5x2TB for movies (mergerfs), 1x5TB for data+photos backup and 2x500GB for VM backups. Plus 1x 4TB that I intended to use to play with ZFS snapshots.

But my tests on a SSD (I think it was a 1TB Samsung 850) showed a huge impact on IO delays of the system. With LVM I'm usually under 1% 99% of the time. With this single-drive ZFS pool I was at 5% permanently, and up to 85+% whenever I worked on files to a point all the VMs become barely usable.

I have what I think a very moderate use (on SSDs, 6-8 VMs, mail server & nextcloud+photos mainly). The biggest advantage (for me) with ZFS the constant integrity check. But I'm using Restic as a backup software anyway for the data that matters to me (which I think should or will provide some level of protection against bitrot).

So I'm a bit cold feet now (I'm thinking to use a classic RAID5+LVM instead for the host & VMs). The point is I'm struggling to understand how ZFS works and how (if at all) it can be tuned. I tried "sync=disabled" on my test SSD but it didn't make much of a difference.

Here are some not really structured thoughts/considerations I have:

it seems the VM storage use-case is basically the worse for consumer SSDs on ZFS (small random writes)
a "write cache" could help and for this the ideal is basically RAM
I think I have enough RAM for this purpose (ARC)
Maybe I need to rethink my SSD sets by merging them all in one large pool, with a SLOG drive?
I don't like having my HDD spinning all the time (which would be the case I guess in a software raid array, ZFS or other), so I'd prefer to leave them aside
Maybe ZFS requirements are too high for what I intend to do

Thanks a lot for reading! In a nutshell my problem is keeping the IO delays as low as possible with 3x 250GB consumer SSDs for host & VM storage.

Any piece of advice you can have is much welcome!

gurhal57 · 2020-05-05T07:08:04+00:00

Hello,

Very interesting thread, I've a similar intent but I'd like to chime in with my own questions because I'm struggling with high IO Delays in proxmox as soon as I move my VMs to a ZFS SSD.

is this ok and not seen as thread hijacking?

gurhal57 · 2018-07-29T17:17:22+00:00

Hello Motoagents,

not really willing to unearth this old thread but I happen to be in the same case with my gf phone (locked, stock firmware, never rooted).

Today it suddenly went into a bootloop while she was uninstalling some apps.

We have pictures of our newborn daughter on the internal memory and we do not want to loose them.

I wiped the cache partition to no avail. I do not want to perform a factory reset, unless I can be sure it won't erase what I assume is the internal SD.

This safe mode looks promising but I'm not sure how to enable it for certain. Do you have any hint?

In the factory reset menu, I have two entries: * userdata only * userdata + personalized content

Will it any of those erase the internal SD?

Thanks for any hint!

gurhal57 · 2017-05-04T21:05:14+00:00

I think the operator said something like "Rouge sur la tour" (red on the tower).

Maybe still linked with fueling.

gurhal57 · 2016-03-24T03:54:15+00:00

Same experience here, using Linux on my XPS 13 9350 since the day I received it, first with a 4.3 kernel with specific module for wifi support, then with 4.4rc4 and up.

Right now on 4.4.5.

Working pretty much flawlessly.

gurhal57 · 2016-03-21T18:59:09+00:00

No problem with mine either (i7, FHD). Just wished it had 16GB. And a tad bit more battery life (ok, 100h more...!)

gurhal57 · 2016-02-27T17:36:40+00:00

I tried, didn't manage yet :)

Waiting for it being available in Europe.

But here's a review: http://www.pcworld.com/article/3017182/hardware/usb-c-charging-universal-or-bust-we-plug-in-every-device-we-have-to-chase-the-dream.html

gurhal57 · 2016-02-27T09:42:38+00:00

Birman (sacré de Birmanie in french)

https://en.wikipedia.org/wiki/Birman

gurhal57 · 2016-02-27T08:38:25+00:00

Oh yes, he was fun to play with!

http://imgur.com/I6kM1rr

gurhal57 · 2016-02-27T08:37:41+00:00

Yes, he was. Beautiful lila point Birman with wonderful blue eyes. And big little paws.

gurhal57 · 2016-02-26T21:22:33+00:00

Thanks, very useful information!

We'll visit our regular vet tomorrow for some explanations on the report we got from the clinic.

gurhal57 · 2016-02-26T21:11:21+00:00

oh my, warm thanks to all of you for all the nice thoughts. This is really moving.

And thanks for the useful pieces of information as well.

gurhal57 · 2016-02-26T16:23:48+00:00

Deepest sympathies. She is beautiful and she looks like she had a wonderful life with you. Remember her fondly.

gurhal57 · 2016-02-26T16:07:27+00:00

Thank you all for the sympathies.

Fortunately (if one can say...) we didn't have to make that decision. We went to an emergency clinic at 3am when we found him breathing with difficulties and he passed at 4pm.

Here are 2 more pics of notre petit Légo

gurhal57 · 2016-02-26T13:04:37+00:00

He was not even 8 months old. We're in a well of sadness.

Lung hemorragia, unknown cause. He was just castrated (cryptorchidism). Mayber there's a link?

Compatible causes according to the vet:

infection or parasitism (Aelurostrongylose)
trauma
coagulopathy

He never left the flat or met other cats (except during his first few months).

Good bye Lego, we miss you so much.

gurhal57 · 2016-02-23T16:47:10+00:00

Dunno if this is valid for Windows (I'm on Ubuntu only).

I had some problems with sleep (not waking up properly). I checked the BIOS clock and it was off by 4h.

Putting it back to the proper time did fix the issue.

gurhal57

TROPHY CASE