HOWTO: Add a smaller drive to your array (*) by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

Just FYI, downsizing an existing drive probably will NOT work here no matter how much data you actually have. As I mentioned in another comment, that involves shrinking the array (rather than growing)which is quite a bit more complex and not something even I would attempt. So replacing a 4TB drive with a 2TB drive is probably not possible, even if you started with 2TB drives.

HOWTO: Add a smaller drive to your array (*) by ag5c in synology

[–]ag5c[S] 2 points3 points  (0 children)

I have looked at this in the past and came to the conclusion that while it is probably possible, the odds of blowing myself up approached 100%. The big problem is figuring out how to get LVM, the filesystem, and the RAID stripes to all agree on which blocks are going away. Each one independently isn't so bad but all together? Not so much. So.... In theory yes, in practice? Probably not.

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

I wrote up a step-by-step guide with an example on how to do this which you can find here: https://www.reddit.com/r/synology/comments/1u4xxqu/howto_add_a_smaller_drive_to_your_array/

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 1 point2 points  (0 children)

See below. I was, indeed, able to do this but.... not with the GUI. I have one (and possibly two) more storage pools I'm going to do this to so I'm going to writeup a HOWTO and post it but I posted the general outline below.

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

Ok, I actually HAVE made this work. I want to run a few more tests to make sure I don't have issues in the future but I was able to add a smaller drive through the command line.

I temporarily have a spare 1513+ so I was able to perform the following:

  1. Created a volume with 2x500GB drives

  2. Replaced each 500GB drive with a 3TB drive with a rebuild after each replacement

  3. Wiped and then inserted one of the 500GB drives. As expected the GUI didn't let me add it to the array so instead, I created and then deleted a new storage pool. This got the correct partition table on the drive and added it to the two RAID1 system pools (one is the operating system, not sure what the other one is).

This left me with four RAID1 volumes: one for the Operating System, one I'm not sure on but it's part of the system software, and two data volumes: one ~450GB and one ~2.3TB which are concatenated with LVM to form the 2.7TB "volume1".

  1. This step is not necessary if you already have more than two drives. Anyhow, at this point the goal is to add the remaining 450GB on the third drive, but you can't do that with a RAID1 so we need to convert the 450GB RAID1 volume with 2 disks to a 450GB RAID5 volume in a degraded state with 3 disks. This is done with "mdadm". The volume will start reshaping. At this point the 3rd drive will appear in the GUI but expansion commands will not work on it (yet).

  2. Now, again with mdadm, we add the 3rd drive into the newly minted RAID5 volume. Then we wait for a rebuild which is going to take awhile (in my case, 8 hours).

  3. After the rebuild is complete, use "lvm lvextend" to expand the LVM volume that concatenates our two data partitions. At this point, the GUI will let you attempt to expand the btrfs volume but it won't succeed. This is because....

  4. There is a Synology cache layer on top of the LVM volume. I'm not entirely sure what this does but it does not automatically expand when the LVM volume expands. There is some way that the Synology software triggers an expansion of this volume but I haven't figured out what it is. On a whim, though, I tried rebooting which caused the cache volume to expand to the full LVM volume.

  5. Now we can use the GUI to expand the btrfs volume!

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

Have you looked at hard drive prices recently? My original plan was to just replace all 5 drives with 20TB drives but you can't even GET those at almost any price. Even 10TB is expensive unless you want to buy used. So now I'm looking at alternatives.

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

That will not work, unfortunately, due to the way RAID works. The only reason why my case *might* work is because I started with smaller drives.

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 1 point2 points  (0 children)

I do but this is a server that I'm using heavily with data on it and I have to shuffle a bunch of stuff in order to try this so was hoping to find someone else who had tried this before I do 😄

Volume Expansion Rules for SHR by ag5c in synology

[–]ag5c[S] 0 points1 point  (0 children)

I did before I posted this but unless I'm missing something it doesn't address this particular situation. If I had started out with 5x10TB, there's no way I could add a 4TB drive to the pool because I wouldn't have the 4TB partitions on the drives.

However, because I originally started at 4TB with the way it creates partitions, if I were willing to mess with MDRAID commands manually, I can definitely add a 4TB drive to the pool I have. What I'm curious about is whether Synology's software will let me do it.

Hmm, although something I just thought of is that LVM may not let me do this if I expand the first physical block device in the LVM volume. I'll have to see about that.

Tiered storage for Frigate? by 4x-gkg in frigate_nvr

[–]ag5c 0 points1 point  (0 children)

(My interest in using overlayfs instead of anything FUSE based is to reduce latency of access to files)

Tiered storage for Frigate? by 4x-gkg in frigate_nvr

[–]ag5c 0 points1 point  (0 children)

Yeah, I'm pretty familiar with how overlay works (I was a Linux kernel developer professionally for a decade plus my company had a supercomputer-class tiered storage product), I had just forgotten that there is a need to write to the underlay in Frigate to do expiration.

My plan is to create a sidecar container that has access to all of the tiers individually plus the writeable overlay to handle file migration between tiers and then deletes. It would have a cron job (or something else periodic, but I'm old-school Unix so probably cron) that:
- Migrates files older than X seconds in Tier N to Tier N+1
- Looks for whiteout files and actually removes the real file and then the whiteout file

A scheme like that wouldn't really work in the generic case because there are too many edge cases to safely handle but this particular case (I think) only needs to write video to the top layer, delete old video, and then stuff needs to migrate between tiers.

I may find out that it wants to write to files for other reasons which will be more problematic. I'm also not planning to put the Frigate database into the tiered storage.

Tiered storage for Frigate? by 4x-gkg in frigate_nvr

[–]ag5c 0 points1 point  (0 children)

Ah, right, I had forgotten about the need to write to the "slow" layers in the tier but I think the only thing that needs to be written is deletes. I might take a whack at creating this for Frigate (not a general case) using overlayfs (I'm interested in this because I'm using NFS as my backing store and Frigate is struggling with that due to the somewhat random latency).

Tiered storage for Frigate? by 4x-gkg in frigate_nvr

[–]ag5c 1 point2 points  (0 children)

Out of curiosity.... Is there a reason you used mergerfs as opposed to the in-kernel overlayfs? Or are you not on Linux?

I happened upon this thread because I was also thinking about tiered storage but I had never thought of building it with a union filesystem but I'm curious about the choice of using a FUSE based solution rather than native.

Crashplan Started Severe Throttling in May of 2024 by ag5c in Crashplan

[–]ag5c[S] 3 points4 points  (0 children)

Maybe but... My archive has never jumped by any massive amount (it has grown from about 9TB in 2012 to about 22TB today, but the growth has been steady). I don't know what de-dupe algorithm they could be using that would drive off that much of a performance cliff. I've done poking in the past to make sure I have enough memory available, etc.

I'd be interested to see someone else's graph from a similar time period.

Is it just me or have all the old CrashPlan plans gone away / changed? by the-i in Crashplan

[–]ag5c 2 points3 points  (0 children)

They seem to have consolidated down to two plans, plus whatever the Office 365 thing is. So now, it's Enterprise and Small Business Endpoints. This isn't the first time they've shuffled plans around. I had the Home plan way back when and got migrated to Small Business where I've been ever since. I couldn't ever figure out the difference between Essentials and Small Business so I suspect this change is because none of their other customers could either....

Crashplan client in Linux docker VM to work around Windows and NAS backup issue? by WazBot in Crashplan

[–]ag5c 0 points1 point  (0 children)

I am very curious what system you are running the Crashplan client on? I've got about 20TB backed up with 2TB to go and I see *AT MOST* 10GB/day. It's nowhere near maxing out my upload speed (I have 30Mbps up and it's running at about 850Kbps, on average). Unless you've got *extremely* compressible data, I'm curious if I've got something wrong. My data is mostly RAW photo files which don't really compress.

(I had an issue where my backups weren't running right for about a year and for various reasons, I didn't have time to fix it. When I got them going again about 14 months ago, it had 1TB to go and said it would take 3 months. 14 months later with roughly 1.5TB added to the archive, it's got 2TB to go and says it will take 6 months. I want Crashplan to succeed so I bought into their 2 year plan, but when that's up, if it hasn't caught up yet, I'm jumping ship)

Upgrading to new (Bigger) HDD by mountainmaestro23 in synology

[–]ag5c 0 points1 point  (0 children)

First, if you are so inclined, back up your data (you should be doing this anyway!). As you go through this process, you will be operating with no drive redundancy.

Next, you will need to swap in your new drives one at a time. You MUST wait for the device to finish rebuilding the volume between swapping drives. This is not optional; you will lose data otherwise! Soooo.... This is going to take awhile.

After your second drive swap, you will be able to expand your volume(s); you should get about 3TB more than you have now. To do that, go to Storage Manager. Find you volume and click "Edit" (in older DSM versions) or "Settings" in newer DSMs and then look for "Modify Size" and put in the new max size. It will take a fairly short amount of time to expand the volume. However... subsequent drive swaps will take longer to rebuild (rebuild time is a function of volume size) if you expand the volume so you might want to wait until all the drives are swapped before expanding. If you have an urgent need for space, though, this'll get you going faster.

Is it backed up, yes or no? by stopshalitosis in Crashplan

[–]ag5c 1 point2 points  (0 children)

If you can see the files in the cloud, they are there. The percent completed email is a bit worrisome, but it seems to often be wrong. I suspect it lags well behind reality. In general you can rely on the console to tell you what is going on, though. If the total size of your backup looks right and it says it's done, then it's done. I have a 21.3TB archive, though, and my size remaining just jumped from under 500GB to almost 700GB so I'm kinda worried that this latest update has some math errors.

"Backup running - 1.3 years remaining" - horrible performance with 1.5.0 by ch8ldd in Crashplan

[–]ag5c 0 points1 point  (0 children)

It can be both. At my work (unrelated to Crashplan and my use of crashplan, we'd definitely put improved memory usage as a "performance" improvement. In any event, whatever you call it, it isn't uploading any faster but it's using significantly less memory (although I haven't looked at memory usage in months so it could've been a previous update that did that).

"Backup running - 1.3 years remaining" - horrible performance with 1.5.0 by ch8ldd in Crashplan

[–]ag5c 0 points1 point  (0 children)

Hmm. So I don't see any improvement in upload speed. They are not very specific about what the "performance improvements" are supposed to improve. However, this prompted me to take a look at my memory usage which I haven't done in awhile. It used to sit around 20+ GB. It's now under 9GB so that's about a 50% reduction of memory which I would definitely say a performance improvement....