My Cloud Backup Strategy

[Mallefitzo]

Hi!

This is my first post in this forum and I'd like to first thank everybody for the wealth of information that has been shared here.

In this post I would like to share my overall data backup strategy with you guys because I know you can provide valuable feedback to further enhance it and make it even more secure but also in the hopes of helping people deciding for or against a particular (cloud) backup strategy.

The situation
I think it is best to lay out my current computer setup to therefore determine my requirements for a backup strategy. So here we go:

Computers: 2 Macs (iMac, Macbook Pro)

NAS: Synology DiskStation 212+ with 5 TB storage capacity

Data: Overall, I need to backup around 2 TB of data (1TB from my iMac, 200GB from Macbook Pro, and around 800GB from my NAS.

I do a lot of videos and raw photos with Photoshop editing so files can get quite large (easily >2GB).

Requirements

Of course, I want to backup everything. As you might already know, one backup is not enough, so I plan to have at least double local redundancy and a cloud backup solution to end up with triple redundancy. The reason I want a cloud backup solution is that I cannot risk a fire or burglary take all my files away.

Continuous backup
I want my files to be continuously backed up whenever I edit or change a file. As I'm using a Macintosh I'm using Time Machine and a Time Capsule for my first backup. That is my first layer of protection for my iMac and Macbook Pro.

Time Machine
Time Machine is a good option as it is build in and works quite well. However, I tend to have quite a few hiccups now and then. A great website that talks about Time Machine backups is this one: http://pondini.org/TM/Clones.html

SuperDuper
For the second redundancy I use SuperDuper to create a second backup on my NAS. SuperDuper allows you to fine tune your backup settings a little bit better than Time Machine and I tend to have less issues with it.

NAS Backup
While my NAS consists of two different hard drives (WD RED Series) and set to Synology's Hybrid Raid I back those files up to an external hard drive that is connected to it.​

Cloud Backup
Yes, double redundancy is great but I think you need to backup your most important files to an off-site location. The easiest thing being to choose an online backup service for your needs. Of course, you could go for peer-to-peer backup solutions where you can backup to a friend's computer. Crashplan offers this method for free.

What I need
Choosing an online backup service is tough as stevech points out in his thread. I, too, have strict requirements for my online backup service which at times is difficult to get under one hood. I don't want to end up juggling with n-amount of services.

• Unlimited Online Backup - I absolutely need a service that offers unlimited online backup as a pay-as-you-go service would be too expensive for a couple of terabytes of data. Here is a good comparison chart where you can filter various services for their features and storage plans: http://www.onlinebackupreviews.org/comparison/
• Generous file versioning - File versioning is very important in the case you accidentally save or overwrite a file. With versioning you can travel back in time, so to speak, and recover previous versions of your files.
• File/Folder sharing - not a huge priority but I would like to be able to quickly share files or folders with friends and family or colleagues.
• NAS Backup - As I store lots of data on my NAS I want an online backup service to upload those "mapped drives" as well.
• Multi-computer backup - as I have two Macs, I need to be able to backup those two machines.

Results?

Well, it turns out it's hard to find a one-size-fits-all solution. If you want unlimited backup you can almost always expect not to be able to upload your NAS data, external hard drives maybe, but that too tends to be difficult. If you want NAS backup and file sharing, you need to go for a service that only offers limited storage space. Let's have a look at a couple of services that might match our criteria:

Unlimited Online Backup Services

• Crashplan - Crashplan is quite popular as you're getting unlimited online backup for as low as $5.99 per month per computer. But I can't share files. There is a little trick to make Crashplan backup my NAS as well, but it is not officially supported unless you purchase the business version which gets a lot more expensive. Also, Crashplan performed poorly with regards to backup speed. I like the fact that it offers local encryption prior to uploading files to their servers.
  
• Backblaze - Cheap options for unlimited backup ($5 per month) but no file sharing or NAS backup.
  
• Carbonite Home - Similar to Backblaze and Crashplan except there is no monthly billing available and you cannot backup an external hard drive unless you go for the more expensive plans. No file sharing, no NAS backup unless you go for business.

Of course, there are more but features are more or less the same with similar restrictions. Carbonite limits bandwidth severely for Home accounts that's why I wouldn't choose it for my purposes.

Limited Online Backup Services

• Mozy - is a good, solid service, yet with the Home plan it's difficult to get your NAS backed up.
  
• ElephantDrive - ElephantDrive is decently priced and offers everything I need. ✔ NAS, ✔ file sharing. It can get expensive quite quickly because I end up paying for 1TB around 85$ per month.
  
• IDrive - this one offers an interesting plan: 1TB for 299$ per year. I can backup my NAS and share files.

In the end, I ended up choosing Backblaze for my Macs as a hands-off backup solution. Backblaze backs up "everything" except a few system files. If you need a bare metal backup you need to look at other services. For my NAS I signed up for Crashplan and use the workaround to back that up, although I don't feel good about it. Do you have a better option?


Security
One thing I haven't really touched in this post is security. Most cloud backup service encrypt files via SSL and then perform a server-side encryption of the files. Yet, choose a service that lets me set my own encryption key so that only I can see my files. Even if I asked their staff to look at my files, they couldn't. One could delve much deeper in to the security aspect of cloud backup, but maybe that's for another post.

I hope I could show you how I backup my data. It would be cool if you cared to share your thoughts.

-Mallefitzo

 

[stevech]

I've tried most of the on-line backup services.
With residential internet uplink speeds, one can backup only VIP data.

Some governments (US, et al) require on-line services to respond with best effort to a court order to provide user data files. I think that's why the service providers re-encrypt - combined with their strategies to do block-level de-duplication. IMO, the issue is not government, but a disgruntled employee/contractor at the service provider that has access to the keys needed to answer the court order. This can't perfectly restricted.

Therefore, one should not let sensitive data (taxes, financial, job, ...) get uploaded as-is. Instead, any sensitive data needs to be encrypted by my own means with a key that the service provider cannot know.

What I do: I have an encrypted virtual drive - using "SafeHouse" software (free). In that 750GB drive I keep all sensitive data, and that drive is dismounted automatically if there are no files open for work in progress. I found it simpler than TruCrypt.

Because of the sizes of such things, uploading to an off-site backup service is just too slow. My NAS has a time-backup history on a second drive's independent volume. And automated backup to a USB3 drive. And VIP files to a one-drive NAS (old, slow), that's hidden in the house.

Etc.

I believe my greatest risk is burglary, given I don't upload sensitive files that I myself have not encrypted.

to me, as a NAS owner and geek, with automated reliable multi-backups, the use of an on-line backup service is more for sharing with selected people. That's a weak argument too, given the NAS has remote access. And there's my 64GB SD card that stores backups and goes in a safe place.

Crashplan is good if you backup to a friend's computer/NAS disk. It won't backup to their server if the source is a mapped drive letter to a NAS, or an SMB share.
The above is true for virtually all service providers.
Amazon S3 is good, used with freeware for the UI. But it's not inexpensive by my measure.
Amazon S3 is rebranded by many service providers, e.g., Rackspace. S3 is a good choice for SOHO and SMBs.
Carbonite is OK for the masses- too dumb for a geek. Same, for Acronis on-line backup (I do use Acronis for drive imaging).
Quite a few others I tried - were too crude/limiting, such as iDrive, Adrive, and some providers in the UK.

OpenDrive - had big problems until a year ago. Having tried most all and I don't rely on it 100%, is my preference. Last year or so, they've been stable. And they have the all-important Windows virtual drive rather than only a web browser or custom-client software based upload. But be sure: they (or most any other) will eventually lose some or all of your data, and/or will be down for long times. OpenDrive has customers that "sell" files. I can imagine what that is about; I don't do so. But I wonder if they could get in trouble with DRM someday. They have a "custom" priced plan that gives 100GB for $60/yr.

That's a semi-short story.

 

[Tim Kohler]

"Cloud Backup
Yes, double redundancy is great but I think you need to backup your most important files to an off-site location. The easiest thing being to choose an online backup service for your needs. Of course, you could go for peer-to-peer backup solutions where you can backup to a friend's computer. Crashplan offers this method for free."

Awesome, I`ve tested your strategy but used mozy -> http://mozy.co.uk/product/solutions I think they are way better than the providers you`ve listed

 

[stevech]

After trying most, and using OpenDrive for 2 years, I'm now on ADrive. Great pricing. Works well.
Used only for VIP folders/files without sensitive info.
And used for sharing via passworded access.

 

[Cake]

What about your own cloud using open source and off site. If off site could mean your garage, cottage or shed somewhere. Here is what is in my head: buy a arm based soc (raspi, etc), run raspbian on it and install syncthing (both are open source-not that I can read code ) maybe there is something better then syncthing...
Plug in some Hard drives!
The part I have not figured out is how to have a encrypted file system re-mount after a reboot/power outage, fetch a password from somewhere secure, mount the drive/container and samba share it. Its the fetch a password securely after reboot that I am stumped on.
A possible solution could be to use ddns on your android phone with a ftp server on it??? (a file with the password)

This setup would all be open source, and the data in your hands plus synced automatically with backups even resuming after a break in the connection too! Plus I believe if its off site and if you use openvpn plus syncthing, your link is encrypted twice.
2 x 2TB hard disks maybe 200 USD plus a small arm computer 40 USD. So maybe its cheaper to use a commercial service, but if you value privacy- then hmmmm

Of course if you use a android phone to keep the password, you might not want google to back up your phone.

 

[Shabbir Rao]

I have been using Syncrify as a third party software for back up on my QNAP. I think your all requirements above mentioned can be handle by Syncrify. It works great for me so I believe it might be workable for you as well.

 

[stevech]

What about your own cloud using open source and off site. If off site could mean your garage, cottage or shed somewhere. Here is what is in my head: buy a arm based soc (raspi, etc), run raspbian on it and install syncthing (both are open source-not that I can read code ) maybe there is something better then syncthing...
Plug in some Hard drives!
The part I have not figured out is how to have a encrypted file system re-mount after a reboot/power outage, fetch a password from somewhere secure, mount the drive/container and samba share it. Its the fetch a password securely after reboot that I am stumped on.
A possible solution could be to use ddns on your android phone with a ftp server on it??? (a file with the password)

This setup would all be open source, and the data in your hands plus synced automatically with backups even resuming after a break in the connection too! Plus I believe if its off site and if you use openvpn plus syncthing, your link is encrypted twice.
2 x 2TB hard disks maybe 200 USD plus a small arm computer 40 USD. So maybe its cheaper to use a commercial service, but if you value privacy- then hmmmm

Of course if you use a android phone to keep the password, you might not want google to back up your phone.

crashplan
http://www.code42.com/crashplan/
is popular software that can do backups to a friendly PC anywhere with no recurring costs.
However, most of us have slow upstream speeds and a full backup and updates are onerous.
Best to have a USB3 drive as primary backup, automated.
I've tried many services, and use Adrive for key/VIP folders, for $25/yr for 100GB.