[lbackup-discussion] General rsync errors

[Scott Haneda]

I should probably bring this up on the rsync mailing list, and will eventually follow up there.  I was using lbackup, but in order to rule out any problems, I have taken it down to just a plain patched rsync. The errors are consistent, in that when I get an error in lbackup, I get one in rysnc as well, and vice versa.

For that, I do not believe that this has anything to do with the labackup scripts, but it does halt lbackup from continuing, whereas, a plain rsync execution will fail on the errors, but generally keep going.

rsyncs error reporting is a bit of a pain, with just one trailing notice as the sync is done, and then having to scroll across perhaps thousands of lines of rsync messages, makes it a bit hard.

Here is my current error:
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1505) [generator=3.0.6]

Here is the command I have gone with, which closely mimics what I was doing on lbackup, without any of the rotational/snapshot aspects...

/opt/local/bin/rsync -vv --delete --delete-excluded --exclude-from='rsync_exclus
ions' --stats --progress --perms --archive --crtimes --hard-links --acls --xattr
s --one-file-system --protect-args --fileflags --force-change --rsync-path="/opt
/local/bin/rsync" root at example.com:/ /Volumes/big_drive/backups/hostname-folder

And here is a smalls sample of what it gets stuck on, where I snipped away thousands of lines of successful transfers.  I would like to know what the (5) error means.  As it is now, I do not know how to get past this.  I do think that lbackup may want to look at continuing and not halting a backup, as some backup is better than none.  In most cases, this is going to be a schedule, and a few days may go by in which someone is not looking at the logs to see lbackup is no longer working.  Or it may just self heal.

The strange thing about the errors below:
$sudo cp -Rp iTunes.app ~/Desktop 
du on the original:
  386584	iTunes.app/
du on the copy:
  386584	/Users/me/Desktop/iTunes.app/

So a `cp` works, but maybe some meta data did not make it.  And oddly, running the same command on just iTunes, works fine as well:

$/opt/local/bin/rsync --stats --progress --perms --archive --crtimes --hard-links --acls --xattrs --one-file-system --protect-args --fileflags --force-change iTunes.app ~/Desktop/test

    sent 177430708 bytes  received 197795 bytes  6702962.38 bytes/sec
    total size is 176707789  speedup is 0.99

Now I go back and run the same command that resulted in the below errors, and it works fine.  Weird.  Is there any way in rsync to get even more verbose output, and by more verbose, I do not mean showing me more of what it is up to, but more verbose in what the errors it is crating are up to.

rsync: readdir("/Applications/iTunes.app/Contents/Resources/Dutch.lproj/EQWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/Dutch.lproj/GradientWindow.nib"): Input/output error (5)
IO error encountered -- skipping file deletion
rsync: readdir("/Applications/iTunes.app/Contents/Resources/Dutch.lproj/SmartPlaylist.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/Japanese.lproj/GradientWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/Japanese.lproj/SmartPlaylist.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/fi.lproj/EQWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/fi.lproj/GradientWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/fi.lproj/SmartPlaylist.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/ko.lproj/EQWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/ko.lproj/GradientWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/ko.lproj/SmartPlaylist.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/pl.lproj/EQWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/pl.lproj/GradientWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/pl.lproj/SmartPlaylist.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/pt_PT.lproj/EQWindow.nib"): Input/output error (5)
rsync: readdir("/Applications/iTunes.app/Contents/Resources/pt_PT.lproj/GradientWindow.nib"): Input/output error (5)

total: matches=148090  hash_hits=135896093  false_alarms=2405 data=7708635448

Number of files: 338594
Number of files transferred: 180
Total file size: 41759608060 bytes
Total transferred file size: 15340074988 bytes
Literal data: 7708635448 bytes
Matched data: 7631441154 bytes
File list size: 8601785

File list generation time: 0.006 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 2442979
Total bytes received: 7720057957

sent 2442979 bytes  received 7720057957 bytes  3829655.81 bytes/sec
total size is 41759608060  speedup is 5.41
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1505) [generator=3.0.6]
-- 
Scott * If you contact me off list replace talklists@ with scott@ *