Multi Thread Rsync Transfer
- by reefine
For some reason when running a single rsync command I am getting 1 MB/sec to 2 MB/sec even when I connecting 2 servers both connected to 1 Gbps ports.
rsync -v --progress -e ssh /backup/mysqldata/mysql-bin.000199
[email protected]:/secondary/mysqldata/mysqldata/mysql-bin.000199
I have over 800 GB of data to transfer split among 500 or so files all starting with:
mysql-bin.000*
I've found that running 25-30 rsync simultaneously from seperate SSH windows gets me upwards of 25 MB/sec but it will take me hours to run these all manually.
Is there anyway to get the 25 MB/sec from a single rsync command?