Linux/Basic commands/rsync
Appearance
< Linux | Basic commands
rsync[1] is an advanced copy and synchronization tool including progress indicator.
Configuration files
[edit | edit source]/etc/rsyncd.conf
which includes don't compress options for some file extensions
Options
[edit | edit source]-W, --whole-file
-z, --compress
compresses the file data as it is sent to the destination machine using zlib compression library
Basic commands
[edit | edit source]- Copy files from remote server to local machine:
rsync -chavzP --stats user@remote.host:/path/to/copy /path/to/local/storage
[2] (explainshell[3])
-c, --checksum
option can slow transfers specially for large files-h, --human-readable
-a, --archive
. Equivalent to -rlptgoD-v, --verbose
-z, --compress
-P, --partial --progress
. --partial keep partially transferred files--stats
, print statistics
- -a, --archive. Equivalent to
-rlptgoD
- -r --recursive recurse into directoriees
- -l --links copy symlinks as symlinks
- -p --perms preserve permissions
- -t --times preserve modification times
- -g --group preserve group
- -o --owner preserve owner (super-user only)
- -D same as --devices --specials
rsync -chavzP --stats user@remote.host:/path/to/copy /path/to/local/storage receiving incremental file list .../...
rsync -a -v --ignore-existing src dst
Compression
[edit | edit source]rsync support compression, but you can also compress your data with other external compression tools before using rsync. Such as bzip, gzip or xz
xz -v -T0 file_to_compress
- -v provides progress bar
- -T0 use all available Threads, multi-threaded compression supported since 2014, version 5.2.0. [5]
Activities
[edit | edit source]- Create a remote copy of your files for backup proposes using
rsync
- Read StackOverflow questions about rsync: https://stackoverflow.com/questions/tagged/rsync?tab=Votes
- Understand the differences between cp, scp and rsync: https://stackoverflow.com/questions/20244585/how-does-scp-differ-from-rsync
- Learn Effect of Trailing Slash / in rsync: https://www.alibabacloud.com/blog/speeding-up-network-file-transfers-with-rsync_594337
- Learn use of
--inplace
for transferring large files and its important implications: http://man7.org/linux/man-pages/man1/rsync.1.html, also evaluate-c, --checksum
impact on transfering large files - Learn about
-W, --whole-file
copy files whole (without delta-xfer algorithm), implications and usage cases such as not making a diff copy. - Learn about
--sparse
option and conflicts with--inplace
See also
[edit | edit source]- ↑ http://man7.org/linux/man-pages/man1/rsync.1.html
- ↑ https://stackoverflow.com/questions/9090817/copying-files-using-rsync-from-remote-server-to-local-machine
- ↑ https://explainshell.com/explain?cmd=rsync+-chavzP+--stats+user%40remote.host%3A%2Fpath%2Fto%2Fcopy+%2Fpath%2Fto%2Flocal%2Fstorage
- ↑ https://linux.die.net/man/1/xz
- ↑ https://git.tukaani.org/?p=xz.git;a=blob;f=NEWS;hb=HEAD