Build a Resilient Modern Home Storage & Backup Solution

I’ll admit it, but my home network tends to push the edges of what consumer technology wants to support.  Two months ago, I had one of those terrible technology events that forces you to rethink your entire network: my Netgear ReadyNAS NV+ failed in a disasterous way, causing me to lose my entire iTunes Library.

As a result, I embarked on a process to rethink my offsite data backup and storage solutions for my household, which in this modern age of iPhones, iPads, AppleTVs, and countless media devices has become fairly complex.  Since the solution that I settled on required quite a bit of research, experimenting and simplification, I’m hoping some readers will find it interesting.

Call it: “Adam’s Home Storage Solution, Fall 2011 Edition”.

Overview: Network Design Diagram

You can see above the relevant elements of my home network topology.  It’s anchored to the internet via AT&T UVerse, which provides a 24Mbps down, 5Mbps up service over VDSL.  The router for my home network is plugged into an 8-port Gigabit switch, which is effectively the backbone for the entire house.  As part of the process of revisiting my network, I discovered that historically I had used a mish-mash of old Ethernet cables, some Cat 5, some Cat 5e, and it was affecting some connections.  A quick trip to Fry’s ensured that, for just a few dollars, I had Cat 6 cables for all Gigabit devices.  (This turned out to be important, particularly for connections to my iMac, wireless base station, and NAS box).

Basic Storage Topology

While my network supports a wide variety of clients, the backbone of my solutions is very Apple-centric.  As a result, my solution is optimized for the following decisions:

  • My media store is based on iTunes
  • My primary server is an iMac running Mac OS X 10.7 (Lion)
  • My on premise backup solution is Time Machine

I was able to simplify my storage needs for the network as follows:

  • The iMac uses the built-in 256 GB Solid State drive for the system & applications
  • The iMac uses the built-in 2 TB standard drive for local storage of most media (downloads, documents, pictures)
  • The iMac uses a 4 TB Seagate GoFlex External USB 3.0 drive for the iTunes library
  • The iMac and all other Macs in the house use Time Machine to backup to the Synology DS1511+, which has 8.3 TB usable space.

The Synology DS1511+ has dual Gigabit Ethernet ports, which allows for particularly good performance when multiple machines are trying to read / write to it at the same time.  Configuring the box to support Time Machine for multiple clients is not obvious, but I’ll write up a separate blog post on that issue.

Overall, the performance of this solution is excellent.  iTunes performance from the Seagate is excellent, both for the primary machine as well as for remote devices utilizing Home Sharing to access media (like the AppleTVs).  We are able to run video off this solution to all 3 AppleTV devices simultaneously with no issues.  Copying a 250MB file to the Synology box takes approximately 2 seconds, and it offers no measurable delay in terms of Time Machine incremental backups, viewing, and restoration.  The entire initial backup of 4.05 TB via Time Machine to the Synology box took approximately 26 hours.

Backup Solutions

Let’s not forget that the impetus for this entire redesign was the tragic and unnecessary demise of the Netgear ReadyNAS NV+, causing massive data loss.  Without belaboring the point, I hope that no one who reads this will ever make the mistake of buying a Netgear ReadyNAS.

That being said, it did lead me to significantly reconsider a multi-tier solution for document protection.

I would have loved to go purely with a cloud-based solution, but the performance is just not there yet for multi-terabyte systems.  Not only does it take an inordinate amount of time to upload terabytes to the cloud, but in the case of data loss, recovering the data would be equally slow.  Uploading 400+ GB to the cloud took me approximately 40 days… 4 TB would have taken over a year!

As a result, I factored my content into what I absolutely could not live without.  I settled on my 450 GB of photos and home movies that would be devastating if lost.  For $90, I subscribed to Crashplan Pro, which offers unlimited storage and came highly recommended by everyone.

As a result, for this crucial data, I have 3 levels of protection:

  • Primary storage
  • Secondary backup via Time Machine to Synology RAID can tolerate up to 2 disk failures simultaneously
  • Tertiary off site backup to CrashPlan

For the rest of my data, I have a fairly robust solution, but I’m considering storing 4 TB drive offsite somewhere periodically to add that “tertiary” level of security / safety.

Final Thoughts

The above solution may seem like overkill to some.  OK, probably to most.  However, you can simplify the solution above based on your needs.  For example, if you have only 200 GB of data to protect, maybe CrashPlan is the right “set and forget” solution for your network.  Maybe the 4 TB Seagate drive is sufficient for your Time Machine needs.

For those of you interested in the Synology box, I plan to write up a follow-on post on how to configure the Synology DS1511+ for Time Machine on Mac OS X 10.7 Lion.

Upgrading a NetGear Infrant ReadyNAS NV+ to 6TB

Recently, I’ve been evaluating different solutions for upgrading my home storage solution for backup and file storage.  A couple of years ago, I decided to purchase an Infrant ReadyNAS NV+, which offers appliance-level simplicity to deploy a virtualized drive over a flexible RAID system.   It’s a 4-drive system that supports hot-swapping of drives and optimized Ethernet traffic for mixed (Mac & Windows) networks.

I’ve been happy with the ReadyNAS, and performance has been fairly good since I upgraded the Gigabit switch that I use.  However, over the past two years, my storage needs have grown:

  • iMac 27″: 2 TB drive for documents / applications / photos, 2 TB drive for iTunes, 2 TB for Time Machine
  • Macbook: 250GB main drive

The ReadyNAS has 4 750GB drives, providing 2.25 TB of available storage.  At the time I deployed it, my backup needs were about 1 TB, so I could use the drive for backups and incremental updates.

The problem now is the iTunes drive.  It’s too large to backup effectively with Time Machine.  I’ve been using Carbon Copy Cloner to update a disk image of the drive on a weekly basis, but I’ve found that it’s extremely finicky and errors out in a number of situations.  Plus, at 1.6TB, the iTunes library will likely outgrow it’s 2TB home sometime in 2010.  (If you’ve ever purchased a TV season on iTunes, you’ll understand the storage needs).

In order to figure this out, I tried asking the question on Quora, LinkedIn, and Twitter.

So, I decided to make the big move to upgrade the system.  Looking at prices on NewEgg, I decided to opt for the Western Digital WD15EARS SATA 1.5TB drives.  Low power and 64MB of cache.  $109 each.  (Great price – selling the 750GB drives will likely pay for 25% of the upgrade).

Unfortunately, the drive wasn’t listed on the compatibility page on NetGear’s website.  Fortunately, a quick board question provided me with the info I needed – the drives will work, if I upgrade to the new beta firmware (4.1.7 T29).

So that’s what I’m doing tonight:

  • Upgrade firmware
  • One-by-one replace each 750GB drive with a 1.5TB and let it resync
  • Once all four drives are replace and synched, reboot and let it reconfigure to the 4.5 TB logical size.

Once I get the ReadyNAS NV+ to 4.5 TB, I’m going to move my iTunes library to the ReadyNAS.  This way, it can scale easily to more than 2 TB, and I don’t have to worry about backup because of the RAID configuration.  (I have a clone of most of the library on a Mac Mini in the kitchen.)  I will then move the 2 TB drive that currently houses the iTunes library, and move it to the Airport Extreme hub so I can use it as a Time Machine drive for the MacBook.

I’m not sure this information is actually useful to anyone.  My guess is that someone, somewhere out there will want to know that you can, in fact, upgrade the Infrant ReadyNAS NV+ to more than 4TB, and that you can use the Western Digital DV15EARS 1.5TB drives with it.  And maybe, just maybe, someone out there is morbidly curious about the evolution of my network storage.

Or so I hope.  I’ll update this post if anything goes wrong.