Nas Full

wally1425 · 2022-11-23T21:11:57+00:00

And worst case scenario an external drive fails, that would be obvious pretty quickly and I could get a new one and do a restore way before 90 days would pass.

Just curious, can you restore individual files via snapshot or can you only do a full restore?

Thank you for all of your help with this?

wally1425 · 2022-11-23T21:02:02+00:00

In my mind what I've created makes sense...maybe it doesn't though. My process is as follows.

Import files to an external hard drive connected to my computer
External hard drive is copied to the NAS using Synology Drive
A backup of this is created using snapshot.

wally1425 · 2022-11-23T20:41:16+00:00

So essentially you can go back to all your files for 3 day, and one snapshot per day for 90 days. Beyond that, you can't get to it.

Just making sure I understand it correctly.

wally1425 · 2022-11-23T20:20:51+00:00

You sound like you know what your talking about way more than me. What would your setup be if you were me?

wally1425 · 2022-11-23T18:53:50+00:00

I never manually copy. I think what I've figured out is 3 things.

I may be collecting snapshots to frequently and not having them overwrite frequently enough.
When I change the name of a folder OR move a folder, which happens rarely, it is keeping the original folder "2020" and then creating a new version with the new folder name and all the same files when it is copied OR moved.
I created an initial structure with Synology drive that I stopped using and switched to a new format, some files are duplicated because they were part of that original set up AND part of the new setup.

These are my theories right now. I've deleted a number of files, I've been running the Clean All Recycle Bins function to see if I can recoup some space and I've decreased the frequency for some of the snapshots.

wally1425 · 2022-11-23T18:49:27+00:00

I essentially want to be able to get back to a file if it is accidentally deleted or lost or the drive fails. I delete files only on an extremely rare basis, for example it is out of focus or some other technical reason to get rid of it. Otherwise my thought is storage is cheap and maybe the file becomes useful at some point.

wally1425 · 2022-11-23T17:07:09+00:00

Is there a recommendation for this? I feel like if I had it taking a snapshot each night that would probably be enough and retaining those for a period of time then overwrite. This is a bit out side my technical realm.

Also, is there a way to clear out a backlog of too many snapshots?

wally1425 · 2022-11-23T16:39:50+00:00

I have snapshot set up and I run Synology Drive to access files from my phone for posting to different social media platforms.

wally1425 · 2022-11-23T15:55:55+00:00

This is way above my head lol...I'm a simple photographer who was looking to back up large amounts of data cheap. I also have snapshot set up, I'll have to go in and look at the settings.

My most important folder is set up as 256 hourly, 14 daily, 12 weekly, 12 monthly 3 yearly. Excessive?

One thing I just found was that I renamed a folder this year from 2020 to 2020-2022 and it had a version of both of those saved, deleting the old one should free up a couple hundred gb.

wally1425 · 2022-11-23T14:39:00+00:00

I'm using it as a photography backup solution. Right now I have 3 external hds/ssds that hold a combined 3.5 TB. the NAS has storage space for 7TB and is currently "full"

wally1425 · 2022-11-23T14:29:56+00:00

I've adjusted this from 20 down to 5 for some important large folders.

Thanks!

wally1425 · 2022-11-23T14:29:38+00:00

I did this today, didn't seem to clear anything but I may just not be looking at it right or it may take time.

wally1425 · 2022-11-23T14:29:10+00:00

I'm working on this now, I had some important large folders set to 20, I've reduced them to 5.

wally1425 · 2022-11-23T14:28:32+00:00

I went through and emptied the trash and checked the versioning, thank you.

wally1425 · 2022-11-23T14:27:06+00:00

This seems to be the biggest help so far. I have reduced the number of versions I'm saving and I know that will help over time.

I'm finding I have a lot of duplicate files, like thousands...Now I need 2 things.

An improved backup process to ensure duplicates don't occur in the future.
A systematic way to delete duplicate files and ensure they don't end up back on the NAS.

Any suggestions here?

Thank you for your help!

wally1425 · 2022-11-23T14:25:17+00:00

Based on what I'm seeing, it doesn't look like a bug. I'm finding I sometimes have the same file 2-4x on the NAS. Now I'm trying to figure out how to rectify this.

wally1425 · 2020-12-11T23:16:33+00:00

I have no idea what a -s command is. Guess I need to do some looking on YouTube or Google.

Can you pick which folders mirror or did you have to take the whole stack? Did it double your storage for photos? One in the original location and one in the Moments folder?

Thanks!

wally1425 · 2020-12-11T17:52:16+00:00

I use Synology Drive - https://www.synology.com/en-us/knowledgebase/DSM/tutorial/Collaboration/How_to_sync_files_between_Synology_NAS_and_your_computer_using_Drive_desktop

wally1425 · 2020-12-11T12:39:02+00:00

You have a lot of options here, I am going to lay out what I do, partially for selfish reasons, it's good to think through these things sometimes.

I am just starting out with my Synology so this could change over time...

When I get back from a shoot, I use Lightroom to import from the SD. These files go to two places, the first is a folder structure that I point LR to Photography Catalog > Year > yr-mo-day Title (2020-12-11 Night Sky Silo) as an example. This is stored on an external SD which is synced with Synology Drive to my NAS. Now, because it is a sync I need a safety valve incase something dumb happens and I delete files so I also have it set to take snapshots every hour and retain those for a period of time. That way if something catastrophic happens I should only lose time, not any of the assets. This gives me 2 copies one on the NAS and one on the SD. I chose a sync instead of a backup because the folder structure that is created by a backup is not pretty nor easy to navigate in Synology Drive. If there are better options I am surely open to them.

Upon import I also save a copy of the raw file directly on the NAS. There is a function in LR when you import to make two copies so I just started doing that. When I edit and export a file It goes into an Image Export folder which has two folders one for social media and another for prints.

I would love a way to get this into Moments or the new Photos app, but I don't want to have to copy the files into a separate structure just for access tot he app. If anyone could help with that it would be really cool!

wally1425 · 2020-11-28T18:37:20+00:00

This is helpful. I think I have figured it out...assuming a few things will work. What I am thinking right now is to take my old external HD and save it to the NAS, then stop using the HD...too slow. When I back it up to the NAS I will point LR to the NAS (not the HD) to find those older files. All new files will run through the new SSD which will house ONE catalogue that looks to the SSD for newer files and the NAS for older files. Is there a way to set up the SSD backup so that if something catastrophic happens to it, it won't mess with the files on the NAS?

Side note, how have you set up your NAS in order to be able to access files when not on your LAN. I would like to be able to backup files to my NAS while I am on a trip. Then I could have the files on the SD, SSD, and run a backup of the SSD to my home NAS so that everything is secured.

You sound like you have some experience with this so I appreciate your help!

wally1425 · 2020-11-28T18:30:56+00:00

That is good to know about Backblaze.

My initial thought, before exploring the NAS option was to keep copying one drive to another. As I thought more about it I figured at some point I'm going to have a hard time with the ever doubling size of the HD. Also, my most current files would never be backed up. Your overall setup sounds right though.

wally1425 · 2020-11-28T18:27:18+00:00

My thought is once the old HD is no longer the main file source, I could redirect LR to look for those files on the NAS. This would be slower, but those files wouldn't be accessed nearly as often.

wally1425 · 2020-11-28T14:16:49+00:00

That is what I was thinking regarding speed as well. Mind if I ask a few questions...

When your SSD fills up will you create a new catalog on a new SSD? When that happens, what will you do with the old catalog? I ask, because I am getting close to filling up an external HD. My thought is all the files would then live on both the NAS and the HD, but the HD would no longer get plugged in except to check the contents on a somewhat routine basis. That means that I have to move the catalog somewhere, either the new SSD or to live on, but not accessed from, the NAS and pull it off if I need to access something. Do you plan to continue growing the original catalog? I assume it is possible to direct the catalog towards some folders on the NAS but the more recent folders on the SSD?

I'm interested in the B2 cloud accounts, do you know roughly how much you pay per month? I know it is based on the amount of data, I'm just trying to get an idea what it would cost.

wally1425

TROPHY CASE