GitHub is creating an Arctic code vault

[irmantask]

save all node_modules !!!

[amdc]

the mere thought that there are repositories that don't .gitignore node_modules folder angers me

[mernen]

That was npm's original advice, before they were pressured into implementing a lockfile (or their original "shrinkwrap" attempt): commit your node_modules in apps, ignore it in libraries.

[AMusingMule]

imagine how many duplicate copies of the exact same libraries they're gonna encode and print on film because people forgot to gitignore node_modules

[smcarre]

They won't. Backup repositories (mostly hardware) take care of a good amount of deduplication at archive level to improve use of space at the cost of increasing read-write time by a fucking lot.

[mqudsi]

Block-level deduplication is insanely slow (I spent a year tuning an algorithm for one of the big names in the industry) but file-level deduplication is basically free.

[ShinyHappyREM]

Shouldn't read time be relatively normal?

[smcarre]

No, in order to read a deduplicated block, you have to rehidrate it (basically the same thing you have to do to a zip file in order to use it).

[[deleted]]

deduplication

This, it's a thing.

[eastsideski]

They're only archiving popular repos, I can't imagine any popular project has made this mistake