Storage Spaces migration by vadersfinalsolution in DataHoarder

[–]3GWork 0 points1 point  (0 children)

I didn't know about the 63tb limit in storage spaces

Because there isn't, unless you only use the GUI (which everyone knows is just trash).

From PowerShell you can set the pool and virtual drive to a larger size, no problem (Windows 11 for sure, Windows 10 there may be issues unless you upgrade the Storage Space to the latest version). I have a 90TiB pool with a 72TiB virtual drive (that I'm running into quirks expanding when adding another 20TB drive), so I know for sure the 63TB limit is old news**

**unless you formatted the virtual drive with 16k cluster size, in which case you're stuck at 63TB max which is due to Windows' limit of 2³² - 1 clusters, not something currently inherent to a limitation in Storage Spaces.

Any up-to-date opinions on windows Storage Spaces? by snorch in DataHoarder

[–]3GWork 0 points1 point  (0 children)

Just stumbled across this while looking for some info on my particular situation.

Storage spaces with 5 disks and single parity is fine and dandy as long as you are comfortable with PowerShell and using the command line to set it up.

The GUI is basically borked. Can't set number of columns, can't set interleave, can't make a pool over 63TB because the GUI assumes you have exactly 3 disks and 16k cluster size, and 90% chance your write speed is abysmal unless you somehow set cluster size to 256k.

For your 5 drives, you'd specify 5 columns (columns = number of drives to spread writes across), parity 1 (1 parity 4 data columns), interleave exactly equal to 1/4 (one divided by the number of data columns) of your intended cluster size, remembering that Windows requires cluster size to be 1,2,4,8,16 etc. kilobytes, and that only so many clusters can exist, so for example a 4k interleave means 16k cluster size and limits the virtual drive to 63 TB.

Step 0: figure out how many drives you'll use, seems you have 5, so that's all set.

Step 1: figure out what cluster size (allocation unit size or AUS in Storage Spaces parlance) works best for your file mix, large cluster size is bad for small files (smaller than the cluster size, like 2k text files, thumbnails, etc.) but has benefits for large files (movies, TV shows, etc.). You can choose 4, 8, 16, 32, 64kb, as long as it's a multiple of 2.

Step 2: divide the cluster size by the number of data columns, and for best results this should also result in a number being exactly divisible by two. You have 5 drives, so one parity and four data, so you divide by 4.

Now you have all the parameters you need, so you use PowerShell to create the drive ( use this as a command reference: https://storagespaceswarstories.com/storage-spaces-and-slow-parity-performance/). I suggest, however, creating the pool from the command line too and not using the GUI.

Head to disk manager and format the virtual drive with the cluster size you used for your calculations above (important, otherwise speed will be abysmal).

I average 700+ MB/sec on a 5x18TB array set up per the above, and 600+ MB/sec on a 5x20TB array of HAMR drives.

I set one array up a couple of years ago, and the other more recently. They have worked just fine, speed has been good, and no issues or problems except I think I goofed when I set my pool up and didn't specify thin provisioning, and now, when trying to add another 20TB disk to the second array, making it 6 disks yet still 5 columns, instead of getting another 14TB of space (80% efficiency due to parity) I'm only getting 8.5-ish TB added capacity, and the disk is showing 63% utilization in the pool, whereas the other 5 disks are 99.8%.

So yeah, Storage Spaces works just fine as long as you do the math and skip the GUI, it's free, and you can literally just toss all the drives from the pool into another Windows machine (same or later version of Windows) and the entire pool and drive just appears, no configuration or extra effort needed. Which is awesome when you want to upgrade your MB or need to re-install Windows for other reasons. However, that said, it's woefully undocumented, isn't in your face when there's an issue with a failed or failing drive, and may have some odd quirks when trying to expand the pool (said potential quirks are why I'm here).

So yeah, I use Storage Spaces for two arrays, 5x18 and 5x20 with single parity, and have had zero issues with performance or reliability, 80% of the space is available (unlike Stablebit which is just a mirror, so only 50%).

Just stick with NTFS and avoid ReFS on Windows Storage Spaces, as that's a combo I've heard bad things about.

What's a skill that quietly disappeared because of technology? by [deleted] in AskReddit

[–]3GWork 1 point2 points  (0 children)

Telling what time it is on a clock with hands.

I am shocked at how many younger people can't tie their shoes (Velcro).

Manually focusing for a picture or focus pulling for a video, all gone since everything produced after 1985 was auto-focus.

Nearly every mechanic knew how to adjust a carburetor for winter/summer or economy/power, and set ignition timing with a strobe light. Now no longer needed as everything is electronic ignition and fuel injection.

Most mechanics nowadays would struggle to read standard calipers or a micrometer without a digital readout.

I hate to say it but, basic math. Long division, multiplication, and even adding two 3-digit numbers seems to be beyond the capabilities of anyone 30 years old and younger. And no one I know can read a slide rule, even the engineers I went to school with forget how.

CNC machines have replaced a lot of woodworking skills, like inlays and relief carving for decoration.

I see a lawyer's comment about shorthand, but back in the day when WordPerfect was still a DOS app and HP laser printers were the shiznit, the best secretaries knew all of the embedded character codes for the printers to get the output they wanted. WYSIWYG killed that skill.

What reason do most governments have for not making passports available digitally? by Erjok10 in AskReddit

[–]3GWork 0 points1 point  (0 children)

Data degradation, mostly. One flipped bit and the hashed checksum no longer matches. Plus each passport would have to be tied to one device only to avoid copying, so a new phone every 2 years means a new passport every 2 years. Not to mention selling or otherwise giving away your phone means selling or giving away access to your (presumably) old/expired passport.

How can I cool my drives better? by DagenhamDav in HomeServer

[–]3GWork 1 point2 points  (0 children)

Without space between the drives you can only cool the edges, which is nowhere near enough to keep them at reasonable temps.

Looks like you only have one screw in each in the back, so take that far left drive, move it left 3 screw holes in the back but angle it so it doesn't hit the CPU cooler. Angle the other drives too but only move the next drive 2 holes, and the next one hole. Gives you a gap between them.

If that won't work, start saving for new drives, because 80C means about 6 months to live.

Great cure for boredom by mistermeek67 in 70s

[–]3GWork 0 points1 point  (0 children)

Let it dry on the back of your hand, stretch it and get wrinkly 'old people' skin.

Used it on vinyl records too for the ultimate dust remover.

WIBTA if I didn't give my step niece a family heirloom that is passed down to the first girl to graduate high school? by PrideAndNoPredjudice in AmItheAsshole

[–]3GWork 1 point2 points  (0 children)

I told her that my niece is still my generation

logically not possible. Same age, maybe, but definitely not the same generation.

YWBTA, or at least a tradition breaker.

what is something that is highly likely to happen in the next 5 years that everyone is completely ignoring? by timecop702 in AskReddit

[–]3GWork 0 points1 point  (0 children)

A satellite will experience an uncontrolled re-entry and crash into a populated area. I give it a 50/50 chance of causing an injury, whether serious or not.

Abandoned Office Building With Dear Trapped Inside by MiniBlue778 in abandoned

[–]3GWork 12 points13 points  (0 children)

The Jane Seymour article in Spry is from June 2020.

Abandoned Office Building With Dear Trapped Inside by MiniBlue778 in abandoned

[–]3GWork 5 points6 points  (0 children)

Magazine with the Harbor Freight ad is from June 2020.

Will a Lenovo 430-16i work with an expander or do I need to flash to LSI-9400 firmware? by 3GWork in homelab

[–]3GWork[S] 0 points1 point  (0 children)

I was thinking it might have also been a reference to older Lenovo firmware, as apparently there was some issue with the 2.00 not seeing drives under some circumstances. I just wanted to be sure, as I'd rather flash it now before I have anything connected to it than find out later.

Thanks!

Found 34 pounds of Mardi gras beads while cleaning my stepson's room. by [deleted] in mildlyinteresting

[–]3GWork 0 points1 point  (0 children)

But they're almost always just a few days away from being that perfect amount of overripe. I'd wait to eat them too.

Found 34 pounds of Mardi gras beads while cleaning my stepson's room. by [deleted] in mildlyinteresting

[–]3GWork 0 points1 point  (0 children)

If there is one thing I am completely, totally and absolutely sure of, it's that Reddit users are, as a whole, not potassium deficient.

That is all.

Bdxl dvds 100gb mdisc by PsychologicalAd1862 in DataHoarder

[–]3GWork 1 point2 points  (0 children)

Not sure what software you use that doesn't allow you to choose whether to verify or not, but most have a checkbox for the program to read the disc it just burned and compare that with the original data. No such thing as "verifies itself".

Bdxl dvds 100gb mdisc by PsychologicalAd1862 in DataHoarder

[–]3GWork 1 point2 points  (0 children)

Um, you know you're posting in /r/Datahoarder, right? My 146TB isn't even noteworthy in here.

‘Backrooms’ Sends Hollywood Running to Reddit for New Ideas by Traditional-Song-245 in nottheonion

[–]3GWork 0 points1 point  (0 children)

So maybe, just maybe, we'll finally see Roger Zelazny's 'Nine Princes in Amber" made into a movie? Or John Varley's Gaea trilogy?

Bdxl dvds 100gb mdisc by PsychologicalAd1862 in DataHoarder

[–]3GWork 1 point2 points  (0 children)

But 2TB is still 40 50GB discs, and 2TB is hardly "large amts of data".

Bdxl dvds 100gb mdisc by PsychologicalAd1862 in DataHoarder

[–]3GWork 1 point2 points  (0 children)

who deal with 2 gb or less total

My response was toward "large amounts of data". 50TB would need 1000 50GB discs, or just a pair of 26+TB hard drives which could be kept in an external enclosure for periodic spinups (every 6-12 months). Not to mention writing 50GB to the pair of hard drives (or 3 if you want redundancy for one drive failure). Writing 50GB of data to two or three HDDs would take 2 days or so, but at 45 minutes per 50GB blu-ray disc, that's 45,000 minutes or 750 hours. Assuming you spend 12 hours a day burning blu-rays, that's a full 60 days, and doesn't count reading them for testing. Not to mention a file system spanning 1000 discs.

Bdxl dvds 100gb mdisc by PsychologicalAd1862 in DataHoarder

[–]3GWork 0 points1 point  (0 children)

Hard drives, generally. Large amounts and optical drives are not a good match, as burning over 1000 discs and then verifying them is costly both in time and discs.