|
FreeBSD General Other questions regarding FreeBSD which do not fit in any of the categories below. |
|
Thread Tools | Display Modes |
|
|||
Slow rsync backup from zfs pool with 99% of files
I have a zfs pool that I want to create a monthly offsite backup of, storing it on a separate disk, which I'm attaching locally.
When I'm performing the rsync, the time it takes to move the majority of each new file is between 1-8 seconds; once the transfer starts, the speed is perfectly fine, usually over 50MB/s - but it's the actual sitting there with the filename, with no other progress, that is causing the delay. My rsync command (with/out -h or --progress makes no difference): Code:
# rsync -turlgxvh --progress /share/ /mnt/ The zfs pool consists of 4x 3TB Western Digital Red disks in raidz2: Code:
# zpool status share pool: share state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM share ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 ada5 ONLINE 0 0 0 ada3 ONLINE 0 0 0 ada4 ONLINE 0 0 0 ada6 ONLINE 0 0 0 errors: No known data errors Code:
# gpart create -s gpt ada0 # gpart add -t freebsd-ufs ada0 # newfs /dev/ada0p1 # mount /dev/ada0p1/ /mnt/ Code:
# zpool iostat share 2 capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- share 2.56T 8.31T 10 0 229K 0 share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 0 37 0 68.2K share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 12 6 1.46M 17.1K share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 0 0 12.5K 0 share 2.56T 8.31T 0 0 0 0 share 2.56T 8.31T 2 34 8.24K 58.7K Code:
# df -h share Filesystem Size Used Avail Capacity Mounted on share 5.3T 1.3T 4.1T 24% /share In future I'll probably just gzip each folder in the share root and transfer it individually. |
Tags |
zfs rsync |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
IPv4 Free Pool Drops Below 10%, 1.0.0.0/8 Allocated | J65nko | News | 4 | 29th January 2010 12:13 PM |
Moving ZFS to a other pool? | amscotti | Solaris | 1 | 28th July 2009 11:49 PM |
backup freeBSD 7.0 using Backup Exec | ccc | FreeBSD General | 2 | 25th April 2009 09:23 PM |
The location of Backup files from portupgrade | paul-lkw | FreeBSD Ports and Packages | 4 | 21st September 2008 05:53 PM |
Rsh/rsync problems | ebzzry | FreeBSD General | 4 | 15th August 2008 08:09 AM |