Subsequent runs of rsync locally don't reduce data transferred
Posted
by
sharakan
on Server Fault
See other posts from Server Fault
or by sharakan
Published on 2012-11-30T21:20:43Z
Indexed on
2012/11/30
23:07 UTC
Read the original article
Hit count: 204
I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup.
rsync
seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and used rsync -v
to copy it to the mounted volume:
[ec2-user work]$ rsync -v dump.sql.1 ../backup/dump.sql
dump.sql.1
sent 821704315 bytes received 31 bytes 3416650.09 bytes/sec
total size is 821603948 speedup is 1.00
Then, I ran it again, expecting to see minimal sent/received numbers because it would just be checksums. Instead...
[ec2-user work]$ rsync -v dump.sql.1 ../backup/dump.sql
dump.sql.1
sent 821704315 bytes received 31 bytes 3402502.47 bytes/sec
total size is 821603948 speedup is 1.00
I'm new to rsync
so perhaps I'm missing something, but isn't the idea that the source and destination files are checked for differences, and then a patch is generated and applied to the destination? Why is this not reducing the amount of data 'sent' to just the size of the checksums?
Some background if it's relevant:
the mounted volume is using s3fs, mounted with s3fs <bucketname> backup
.
© Server Fault or respective owner