<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Rsync Backup System</title>
	<atom:link href="http://alexking.org/blog/2004/12/10/rsync-backup-system/feed" rel="self" type="application/rss+xml" />
	<link>http://alexking.org/blog/2004/12/10/rsync-backup-system</link>
	<description>Alex King, Denver Web Developer</description>
	<lastBuildDate>Thu, 09 Feb 2012 18:02:12 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
	<item>
		<title>By: Monkeywrench &#124; alexking.org</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-55610</link>
		<dc:creator>Monkeywrench &#124; alexking.org</dc:creator>
		<pubDate>Wed, 18 Apr 2007 18:05:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-55610</guid>
		<description>[...] I first got my Quad, I had an automated backup system in place so I set my drives up as RAID 0 (striped) to get the best performance. After this, I&#8217;m [...]</description>
		<content:encoded><![CDATA[<p>[...] I first got my Quad, I had an automated backup system in place so I set my drives up as RAID 0 (striped) to get the best performance. After this, I&#8217;m [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan Hunt</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-11862</link>
		<dc:creator>Ryan Hunt</dc:creator>
		<pubDate>Tue, 14 Mar 2006 15:21:12 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-11862</guid>
		<description>I for bootability I use the Carbon Copy Cloner command line scheme to a disk image that I can restore from. I do this for local/Applications as well.

Otherwise I have not experienced any problems with rsync and resource forks.

I have the automated rsync backups take care of my Users/ every hour and cpio -pdl every day, week, month and year.

The boot volume I snap shot after major upgrades or application installs. (a few times a year.)

This way I get a bootable image that may only need a few fink packages, or applications installed, and my data is backed up every hour with regular periodic snapshots.</description>
		<content:encoded><![CDATA[<p>I for bootability I use the Carbon Copy Cloner command line scheme to a disk image that I can restore from. I do this for local/Applications as well.</p>
<p>Otherwise I have not experienced any problems with rsync and resource forks.</p>
<p>I have the automated rsync backups take care of my Users/ every hour and cpio -pdl every day, week, month and year.</p>
<p>The boot volume I snap shot after major upgrades or application installs. (a few times a year.)</p>
<p>This way I get a bootable image that may only need a few fink packages, or applications installed, and my data is backed up every hour with regular periodic snapshots.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: UrlBlogGrey</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-9039</link>
		<dc:creator>UrlBlogGrey</dc:creator>
		<pubDate>Fri, 04 Nov 2005 18:52:51 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-9039</guid>
		<description>&lt;strong&gt;Synchronizing Data on Multiple Macs&lt;/strong&gt;

Now that my new Mac Mini arrived, I am facing the age-old problem of synchronizing information across multiple machines. I have a lot of transient information (addresses, mail, bookmarks, etc.) on my PowerBook that will need to be synchronized with...</description>
		<content:encoded><![CDATA[<p><strong>Synchronizing Data on Multiple Macs</strong></p>
<p>Now that my new Mac Mini arrived, I am facing the age-old problem of synchronizing information across multiple machines. I have a lot of transient information (addresses, mail, bookmarks, etc.) on my PowerBook that will need to be synchronized with&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Scott Lamb</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-4859</link>
		<dc:creator>Scott Lamb</dc:creator>
		<pubDate>Tue, 05 Apr 2005 19:42:51 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-4859</guid>
		<description>You should look into rdiff-backup. It&#039;s librsync-based and does a couple of things better than your current setup:

1. It has incremental backups, so you can go back in time in a much more sophisticated way than picking the older of drives 1 or 2. Handy if you don&#039;t discover for a week that you corrupted some essential file.

2. It handles resource forks, starting with the 0.13 series. I just got bitten by Quicken - it stores significant data in the resource fork. If you restore Quicken files from an rsynced copy, it will say &quot;Unable to load file&quot;. I had to do some voodoo to recover any data from them at all. I was lucky that I used the backup only a few days after starting to use Quicken. If I had more data, that would have really sucked.</description>
		<content:encoded><![CDATA[<p>You should look into rdiff-backup. It&#8217;s librsync-based and does a couple of things better than your current setup:</p>
<p>1. It has incremental backups, so you can go back in time in a much more sophisticated way than picking the older of drives 1 or 2. Handy if you don&#8217;t discover for a week that you corrupted some essential file.</p>
<p>2. It handles resource forks, starting with the 0.13 series. I just got bitten by Quicken &#8211; it stores significant data in the resource fork. If you restore Quicken files from an rsynced copy, it will say &#8220;Unable to load file&#8221;. I had to do some voodoo to recover any data from them at all. I was lucky that I used the backup only a few days after starting to use Quicken. If I had more data, that would have really sucked.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: alexking.org: Blog</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3764</link>
		<dc:creator>alexking.org: Blog</dc:creator>
		<pubDate>Thu, 13 Jan 2005 22:33:13 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3764</guid>
		<description>&lt;strong&gt;Dodged a Bullet&lt;/strong&gt;
Looks like the time I put into setting up my backup system was time well spent. Today I couldn&#039;t commit code to my Tasks Subversion repository, and &#039;svnadmin recover&#039; didn&#039;t work. Um - yeah.

The good news is that the backup that ran earl...</description>
		<content:encoded><![CDATA[<p><strong>Dodged a Bullet</strong><br />
Looks like the time I put into setting up my backup system was time well spent. Today I couldn&#8217;t commit code to my Tasks Subversion repository, and &#8216;svnadmin recover&#8217; didn&#8217;t work. Um &#8211; yeah.</p>
<p>The good news is that the backup that ran earl&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Meitar Moscovitz</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3390</link>
		<dc:creator>Meitar Moscovitz</dc:creator>
		<pubDate>Mon, 13 Dec 2004 11:25:48 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3390</guid>
		<description>While it looks like you&#039;ve already created a working system, you may be interested to learn about &lt;a href=&quot;http://www.dan.co.jp/cases/macosx/psync.html&quot;&gt;psycn&lt;/a&gt;. It&#039;s a Perl utility that can provide incremental backup with HFS+ support, so it keeps Mac OS resource forks intact.

&lt;a href=&quot;http://www.macosxhints.com/article.php?story=20020711091017747&quot;&gt;Here&#039;s the Mac OS X Hints story on it.&lt;/a&gt;</description>
		<content:encoded><![CDATA[<p>While it looks like you&#8217;ve already created a working system, you may be interested to learn about <a href="http://www.dan.co.jp/cases/macosx/psync.html">psycn</a>. It&#8217;s a Perl utility that can provide incremental backup with HFS+ support, so it keeps Mac OS resource forks intact.</p>
<p><a href="http://www.macosxhints.com/article.php?story=20020711091017747">Here&#8217;s the Mac OS X Hints story on it.</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3380</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Sat, 11 Dec 2004 16:31:05 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3380</guid>
		<description>I may already be running RsyncX because I ran the installer before getting everything working and I think the installer moves rsync and replaces it with rsyncx. I&#039;ve done &lt;code&gt;rsync --version&lt;/code&gt; at /usr/bin/rsync and /usr/local/bin/rsync but both show the same general version information (no mention of rsyncx).</description>
		<content:encoded><![CDATA[<p>I may already be running RsyncX because I ran the installer before getting everything working and I think the installer moves rsync and replaces it with rsyncx. I&#8217;ve done <code>rsync --version</code> at /usr/bin/rsync and /usr/local/bin/rsync but both show the same general version information (no mention of rsyncx).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3379</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Sat, 11 Dec 2004 15:43:07 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3379</guid>
		<description>The -z option compresses the files before transferring them.</description>
		<content:encoded><![CDATA[<p>The -z option compresses the files before transferring them.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mark</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3378</link>
		<dc:creator>Mark</dc:creator>
		<pubDate>Sat, 11 Dec 2004 13:33:30 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3378</guid>
		<description>Now is there a way for rsync to zip the files before moving them over?</description>
		<content:encoded><![CDATA[<p>Now is there a way for rsync to zip the files before moving them over?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3377</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Sat, 11 Dec 2004 05:26:48 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3377</guid>
		<description>Since the current version (still installed) of RsyncX doesn&#039;t clash with the standard rsync anymore, I&#039;ll give that a try.

Honestly, I can&#039;t think of any document types that I really care about that would be affected... text files and JPEGs for the most part. Perhaps I&#039;m forgetting something important?</description>
		<content:encoded><![CDATA[<p>Since the current version (still installed) of RsyncX doesn&#8217;t clash with the standard rsync anymore, I&#8217;ll give that a try.</p>
<p>Honestly, I can&#8217;t think of any document types that I really care about that would be affected&#8230; text files and JPEGs for the most part. Perhaps I&#8217;m forgetting something important?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: plambert</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3376</link>
		<dc:creator>plambert</dc:creator>
		<pubDate>Sat, 11 Dec 2004 05:18:21 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3376</guid>
		<description>Use the command-line version of rsyncX.  It&#039;ll sync the resource forks and finder info, but it&#039;s the exact same command line interface.  It&#039;s easy enough to use, and you don&#039;t have to use the rsyncX GUI.  Otherwise, you&#039;ll be very surprised when a backed-up application or data file doesn&#039;t work when you really need it to...

And you don&#039;t have to learn anything new, just use the path to rsyncX&#039;s version of rsync.</description>
		<content:encoded><![CDATA[<p>Use the command-line version of rsyncX.  It&#8217;ll sync the resource forks and finder info, but it&#8217;s the exact same command line interface.  It&#8217;s easy enough to use, and you don&#8217;t have to use the rsyncX GUI.  Otherwise, you&#8217;ll be very surprised when a backed-up application or data file doesn&#8217;t work when you really need it to&#8230;</p>
<p>And you don&#8217;t have to learn anything new, just use the path to rsyncX&#8217;s version of rsync.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3375</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Sat, 11 Dec 2004 03:55:21 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3375</guid>
		<description>I don&#039;t need (or ever intended) to boot from the backup... I just need to backup all the data files.</description>
		<content:encoded><![CDATA[<p>I don&#8217;t need (or ever intended) to boot from the backup&#8230; I just need to backup all the data files.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Thomas</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3374</link>
		<dc:creator>Thomas</dc:creator>
		<pubDate>Sat, 11 Dec 2004 03:53:07 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3374</guid>
		<description>Alex -

Have you actually tried to boot from one of your backups?  

One crucial difference between rsync and rsyncx is that rsync is _not_ aware of the differences between the HFS+ filesystem and the typical unix filesystems (UFS, ext2, etc.)  RsyncX is -- although it has other problems.  As you mentioned, rsync therefore doesn&#039;t copy some of the metadata which Mac users expect.  More importantly, however, it does not copy file resource fork of any file -- only the data fork.    

The last time I checked, OS X would not boot from a disc whose files had lost all resource forks.  This may have changed, and Apple is definitely moving away from them.   But this doesn&#039;t solve the problem of old files.  For example, in older Microsoft Word documents created on the Mac, the document was entirely stored in the resource fork and it was the data fork that was superfluous.  Turbotax apparently still depends on it.  (see &lt;a href=&quot;http://www.macosxhints.com/comment.php?mode=display&amp;sid200403140651023&amp;title=Salvaging+MacOS+files+in+a+UNIX+World&amp;pid0 &quot;&gt;this link&lt;/a&gt;)

There are two &quot;solutions&quot; that I know of with which one can retain both folks and use rsync for backing up.  One is to use the disk image facilities to create an image, need not require a resource fork.  The other is rather ugly:  back up to an SMB server (which puts the resource fork data files that are named dot, understore, the normal filename and then rsync _that_ file tree somewhere else.  The disk images can be restored to a bootable volume, but the SMB server method does not easily result in a bootable volume -- it merely preserves all of the data.

One of my hopes for Tiger is that the rumors that Apple will support a version of rsync that transparently handles multiple fork files in it pan out.</description>
		<content:encoded><![CDATA[<p>Alex -</p>
<p>Have you actually tried to boot from one of your backups?  </p>
<p>One crucial difference between rsync and rsyncx is that rsync is _not_ aware of the differences between the HFS+ filesystem and the typical unix filesystems (UFS, ext2, etc.)  RsyncX is &#8212; although it has other problems.  As you mentioned, rsync therefore doesn&#8217;t copy some of the metadata which Mac users expect.  More importantly, however, it does not copy file resource fork of any file &#8212; only the data fork.    </p>
<p>The last time I checked, OS X would not boot from a disc whose files had lost all resource forks.  This may have changed, and Apple is definitely moving away from them.   But this doesn&#8217;t solve the problem of old files.  For example, in older Microsoft Word documents created on the Mac, the document was entirely stored in the resource fork and it was the data fork that was superfluous.  Turbotax apparently still depends on it.  (see <a href="http://www.macosxhints.com/comment.php?mode=display&#38;sid200403140651023&#38;title=Salvaging+MacOS+files+in+a+UNIX+World&#38;pid0 ">this link</a>)</p>
<p>There are two &#8220;solutions&#8221; that I know of with which one can retain both folks and use rsync for backing up.  One is to use the disk image facilities to create an image, need not require a resource fork.  The other is rather ugly:  back up to an SMB server (which puts the resource fork data files that are named dot, understore, the normal filename and then rsync _that_ file tree somewhere else.  The disk images can be restored to a bootable volume, but the SMB server method does not easily result in a bootable volume &#8212; it merely preserves all of the data.</p>
<p>One of my hopes for Tiger is that the rumors that Apple will support a version of rsync that transparently handles multiple fork files in it pan out.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3373</link>
		<dc:creator>Alex</dc:creator>
		<pubDate>Sat, 11 Dec 2004 02:38:14 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3373</guid>
		<description>Scott, I just send the output of my shell script to a log file - same deal basically.

Regular rsync uses SSH too, the only difference (as far as I can tell) betwee RsyncX and rsync is that RsyncX preserves Mac OS 9 file meta data. Plus normal rsync is standard on the OS so you don&#039;t need to worry about it being overwritten. ;)

I think you can do something like this to have it mail you the log file:

&lt;code&gt;/usr/bin/uuencode /path/to/filename.log filename.log &gt; /path/to/filename.log.uu
/usr/bin/mail -s &quot;CRON log&quot; username@example.com &lt; /path/to/filename.log.uu&lt;/code&gt;
</description>
		<content:encoded><![CDATA[<p>Scott, I just send the output of my shell script to a log file &#8211; same deal basically.</p>
<p>Regular rsync uses SSH too, the only difference (as far as I can tell) betwee RsyncX and rsync is that RsyncX preserves Mac OS 9 file meta data. Plus normal rsync is standard on the OS so you don&#8217;t need to worry about it being overwritten. <img src='http://alexking.org/wp/wp-includes/images/smilies/icon_wink.gif' alt=';)' class='wp-smiley' /> </p>
<p>I think you can do something like this to have it mail you the log file:</p>
<p><code>/usr/bin/uuencode /path/to/filename.log filename.log > /path/to/filename.log.uu<br />
/usr/bin/mail -s "CRON log" <a href="mailto:username@example.com">username@example.com</a> < /path/to/filename.log.uu</code></code></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Scott Morrison</title>
		<link>http://alexking.org/blog/2004/12/10/rsync-backup-system#comment-3372</link>
		<dc:creator>Scott Morrison</dc:creator>
		<pubDate>Sat, 11 Dec 2004 01:46:40 +0000</pubDate>
		<guid isPermaLink="false">http://www.alexking.org/blog/2004/12/10/rsync-backup-system/#comment-3372</guid>
		<description>Hi Alex

I have a configuration similar to yours -- using my powerbook to back up to my g4/400 using RsyncX nightly.  One experience I&#039;ve had is that because rsync runs autonomously in the background, it is possible that something konks out but you not be aware about it until too late.   I had a situation where I performed a system update on my server and it overwrote rsyncx so my powerbook rsyncx was... well.... not rsyncing.  I caught it about 3 weeks after it happened and thankfully it was just a check I was doing, not a need I had.  but it underscored the importance that the system alert you when something doesn&#039;t work.   

I still have to work on more elegant solution but basically I log all my rsyncs to a rysnc log file that I can view in console.  the rsync command looks something like this:

date &gt;&gt; ~/Library/Logs/rsync.log; time /usr/local/bin/rsync -av -z --eahfs --exclude-from=&quot;/~/backupExclude.txt&quot; -e ssh &quot;~/Documents&quot; &quot;~/Pictures/iPhoto Library&quot; &quot;~/Library&quot; &quot;user@serverIP:path/to/backup&quot; &gt;&gt; ~/Library/Logs/rsync.log

the --exclude-from= switch is a text file containing patterns to not backup... (eg cache files, itunes stuff. etc.

I still want it to email me on failure or something... but I will fuddle around with it.

Also -- I understand what you said about the rsyncx front end... why bother -- the command line with the man pages is much less confusing.  

The other thing I like about rsyncx is that it does this though ssh.  this means that you can backup your powerbook anywhere in the world, so long as you have the domainname/IP of your server (and ssh is turned on)

Scott</description>
		<content:encoded><![CDATA[<p>Hi Alex</p>
<p>I have a configuration similar to yours &#8212; using my powerbook to back up to my g4/400 using RsyncX nightly.  One experience I&#8217;ve had is that because rsync runs autonomously in the background, it is possible that something konks out but you not be aware about it until too late.   I had a situation where I performed a system update on my server and it overwrote rsyncx so my powerbook rsyncx was&#8230; well&#8230;. not rsyncing.  I caught it about 3 weeks after it happened and thankfully it was just a check I was doing, not a need I had.  but it underscored the importance that the system alert you when something doesn&#8217;t work.   </p>
<p>I still have to work on more elegant solution but basically I log all my rsyncs to a rysnc log file that I can view in console.  the rsync command looks something like this:</p>
<p>date >> ~/Library/Logs/rsync.log; time /usr/local/bin/rsync -av -z &#8211;eahfs &#8211;exclude-from=&#8221;/~/backupExclude.txt&#8221; -e ssh &#8220;~/Documents&#8221; &#8220;~/Pictures/iPhoto Library&#8221; &#8220;~/Library&#8221; &#8220;user@serverIP:path/to/backup&#8221; >> ~/Library/Logs/rsync.log</p>
<p>the &#8211;exclude-from= switch is a text file containing patterns to not backup&#8230; (eg cache files, itunes stuff. etc.</p>
<p>I still want it to email me on failure or something&#8230; but I will fuddle around with it.</p>
<p>Also &#8212; I understand what you said about the rsyncx front end&#8230; why bother &#8212; the command line with the man pages is much less confusing.  </p>
<p>The other thing I like about rsyncx is that it does this though ssh.  this means that you can backup your powerbook anywhere in the world, so long as you have the domainname/IP of your server (and ssh is turned on)</p>
<p>Scott</p>
]]></content:encoded>
	</item>
</channel>
</rss>

