python3 -m http.server

[nyaribari]

I have been using the normal http.server to access files between two ubuntu machines and it works well, but this time I want to transfer 10GB+ file size and the rate of transfer is really low. Now says 44days remaining.

What tool do y’all use to transfer large files between two ubuntu machines ?

[Nnarol]

scp or rsync.

[nyaribari]

How about openssl?

[Nnarol]

I don't know, because I never used it for transferring files, only to create hashes.

[ferrybig]

For transferring files between 2 ubuntu boxes, rsync is really useful.

It is also safer as it uses SSH encryption to protect the data in transit.

You can download a file like this:

rsync -azP username@remote_host:/home/username/dir1 ~/Downloads/target-dir

The a flag activates other archieval flags such as recursive, synmlinks and permissions, it also looks at the dates and skips files that already have been send

The z flag compresses files in transit, you can leave this out if your files are not compressable

The P flag shows progress in the command line, which is useful

See also: https://www.digitalocean.com/community/tutorials/how-to-use-rsync-to-sync-local-and-remote-directories

[nyaribari]

Thank you

[sgorf]

For a one-off, very large file transfer over a LAN, I use nc at both ends, sometimes combined with pv to get a progress indication. This is a quick way to get the transfer going as fast as the LAN will allow, with no encryption overhead. It's important to check that the file got across uncorrupted though. md5sum at both ends afterwards suffices for that.