Blog

Data Disasters - Fool Me Once (and hopefully never again)

Data Disasters - Fool Me Once (and hopefully never again)
Userlevel 7
Badge +20

World Backup Day is March 31st

We love using this time to reflect on our habits around data - both personal and professional.

There is a very common belief out there that can be summed up as “My data is safe - I don’t think I need to worry much about backing it up.” This belief is held by the tech-illiterate as well as self-described tech “pros” across the world. And even if they don’t have this belief, per se, there is a trend of people putting data backup at the end of their to-do list. Getting an antivirus solution, a VPN, or shiny new hardware tends to feel more important to most people in regards to their technical “must acquire” list. If there’s one idea I want you to start believing today, it is the following:
 

Incorporating an automated Data Backup plan is one of the most important actions you can take to save yourself time, energy, and frustration.

 

World Backup Day serves as a useful reminder for all of the things that can go wrong with your data:

  • A hard drive can reach the end of it’s lifespan well before the “estimated” date that marketing claims
  • Becoming a victim of a malware/ransomware infection that results in the need to wipe hard drives
  • A dropped laptop can completely ruin a hard drive, especially if its a mechanical drive and not an SSD

I have experienced multiple data disasters in my teens and early 20’s because I gave far too much confidence in the 7200RPM spinning hard drive in my computer. Time and time again, I experienced heartache when I realized that my video projects, pictures, school essays, and updated resumé were lost to malware, a stolen laptop, or the eventuality of a hard drive giving up on life. It wasn’t so much that I misunderstood the importance of having an external hard drive and a backup schedule. For most of my life, I’ve actually owned an external hard drive! My issue was actually remembering to reconnect that hard drive to my PC and run a backup more than once a year (I blame ADHD).  More often than not, my inability to stick to a backup schedule led to the loss of a lot of data that was very emotionally or scholastically important to me.
 

My fellow Community Manager, Tyler Moffitt has some interesting stories to share as well:

Geek Squad Employee Story

I worked at Geek Squad for about 5 years so I’ve had plenty of heartbreak stories when it comes to broken computers and lost data. The most common ones were from young women that had all their wedding pictures lost or older generations who had many grandchildren photos all lost. These are usually conversations with tears and anger, but it’s mostly the confrontation that nothing can be done once the hard drive has died. Very few times do people pay for the exorbitant amount of money that it costs for a deep dive hard drive recovery. Almost all the people have to make do with the loss as well as a very important lesson learned. Usually it was followed by a new computer purchase and then an additional drive for the purpose of backing up data.

The problem was that people assume that these computers are going to work forever, or that there wont be an accident. There is very little one can do to convince someone that they need a redundancy plan and they need to stick to it when they are purchasing a new computer, or everything with their current computer is working well. This used to be having a flash drive or external hard drive that you would regularly backup your stuff to. You could do it manually or have some software do it for you automatically. Things have definitely gotten easier now that we have cloud storage, but that’s only grown in popularity over the past decade.

 

The Good News

Data Backup has gotten so much easier and more streamlined in the past few years. Cloud backup solutions have made the concept of “forgetting to backup” a thing of the past. Using a cloud backup solution also comes with other conveniences such as connecting multiple devices to one cloud account. If you choose to stick with a local backup method, hard drives are cheaper than ever (see below graph) and creating a local backup schedule is very easy on MacOS and Windows.

The reality is that backing up your data is not inherently difficult. Cloud backups and scheduled  local backups are both easy and cheap options for making your files resilient to a data disaster. The hurdle that many of us (including my past self) actually need to overcome is prioritizing the initial setup process of a backup solution. The mistake when I was younger was constantly procrastinating the process of backing up to my external hard drive. That mistake resulted in so many of my files being lost forever. I learned the incredibly humbling lesson of why backups are so vital and I implore you all to not make that same mistake. Taking a couple hours to buy/setup a backup solution is 100% worth the time investment!

 

Tell me your stories

Now I’d love to hear about your journeys with data backup. Have you ever experienced a severe data disaster? What was the catalyst that led to you adopting a backup solution? Do you use cloud or local backups? I can’t wait to hear from you in the comments below!


63 replies

Userlevel 3

Daily backup to cloud.

Monthly backup to offsite USB-drive

Userlevel 5
Badge +4

Reading this and the comments I am reminded of a friend who does voice-over work that I set up with an external drive as backup to his notebook computer that he produced from. He called me up one day and told me that the external drive had died, and when I replied that that was okay as it was only a backup and we can just start with a new drive, there was a long silence. That's when he decided to tell me that he had been making space on his primary machine by "archiving" projects to his backup drive and deleting them from the notebook. That long talk about single point of failure had not taken hold.

Userlevel 6
Badge +6

We always make sure we have local and cloud backups. We had a client who had been hit with ransomware and the only saving grace was their cloud backup. They didn’t have insurance, so their cloud backup was their only chance of restoring their data.

We require all of our managed clients to have on-prem and cloud backups. 

Userlevel 4

Daily backup to azure cloud and internal server.

Userlevel 4

Had an issue several years ago where I thought I had everything backed up completely. Suffered a drive failure and realized that a bulk of my music collection was toast, and not actually backed up. It wasn’t a critical business loss but it was still consequential to me. Lesson learned: Never take your backups for granted and have disaster test scenarios. 

Userlevel 3

Backups are a must, there are so many risks these days that you really need to be prepared.

Userlevel 7
Badge +25

I am big big big on backup, and push everyone I know to consider two backups. One local for fast recovery of deleted files or damaged drive, and one remote for disaster recovery so that the source and backup do not live in the same place. And I recommend that any cloud backup service include a “rewind” function to allow one to go back in time to a previous date , and recovery older versions of files. Why?

 

My PC was hit with ransomware. Sadly, it hit while backing up to a locally connected drive, and that drive was hit as well, Bad timing. But at the time, I used Dropbox as an offsite backup for important documents , files, and media. Sadly (I thought) the auto backup synced all my files with the encrypted ones. But a call to Dropbox and they rewound me to the first version of each file that was not encrypted.  I did a low level format on the PC, installed a fresh OS, reinstalled the apps I needed,  and turned on Dropbox. Within a half day, all my files were back to before the strike.  So yea, backup is your best protection against ransomware for sure. 

Userlevel 2

I always try to be prepared for sudden events, in fact every week a full system backup is scheduled... luckily I never needed to restore, but you never know!

Userlevel 7
Badge +54

I always try to be prepared for sudden events, in fact every week a full system backup is scheduled... luckily I never needed to restore, but you never know!

 

That is the just the point, we never do know what is around the corner.

Userlevel 2
Badge +1

I’ll keep it short, but my story is about one of my customers for whom I configured a backup solution and schedule for their server. The only thing they had to do is manually switch external drives on a daily basis. The reason for this is because we agreed on having a full backup outside of the premises. In addition the off-site backup was encrypted, so should they loose the drive the data would not be open to the public.

This setup worked for years and once in a while we needed the backup te restore some files a user accidentally deleted. So no restore required due to a disaster. Until one day they were hit by ransomeware. On one pc but a pc with access to some SMB shares on the server. A user clicked on a link in a email and downloaded some payload. Webroot was in place, but unable to detect the malware. Probably a zero-day attack. And files were being encrypted, and encrypted……

‘But we have a backup, right” they said. ‘Sure we do’ I responded and so I rushed in to start the restore the files (after first isolating and removing the  ransomware on the user’ pc). Only to discover that they didn’t follow my backup procedure and schedule for the last 3 weeks, because “it’s such a hassle to do once a day”!!.

Now they were confronted with a 3 week old backup as their only route back. 3 weeks of data lost of which a DB with all the scanned documents from their customers. It took them a while to digest this info, but they blamed themselves and started recovering the data in another way. They succeeded, but with a lot of extra time spend. A lot of extra time spend I can tell you. And since then? They want to backup twice a day and whenever they receive an email they don’t trust? They delete it and wait to see if it was important or not. If so, the customer will resent the email.

The morale? Whatever you put in place, whatever technology you have, as long as you don’t see the value of it you might end up like this customer of mine. Only once. You probably don’t make such a mistake twice….

Userlevel 7
Badge +8

We had a customer who refused to switch from a cheaper Backup software. We wernt firm enough and when the server died guess what let them down. 

Userlevel 5

A long time ago in a different lifetime, I thought just using a USB drive for my own personal backup was great.  And it was. Until I lost the drive. In theory no big deal but my PC was starting to have issues so did the full refresh back to factory and then remembered I had lost the backup. I have learned my lesson.

Userlevel 7
Badge +4

We had a client that declined to invest in a decent backup despite numerous recommendations. Suffice to say that after being Cryptolocker attacked (3 times!!) and many bills for recovery man hours, they are now a big advocate of DR!

Userlevel 4

I’ve had some form of file and folder backups even before joining a MSP. We try to get everyone to adopt onsite and cloud backups, at least for important machines.

So far the most important lesson I’ve learned was actually after taking a backup to redeploy a fresh OS to a machine, only to find out after wiping the HDD that the backup was corrupt…
Now I always verify my backups before trusting them, including audits of our clients backups, just in case.

Userlevel 4

I backup to OneDrive and also have continuous backups to a local nas drive.  

Userlevel 7
Badge +25

For large clients/companies, I have used Retrospect, which I have used for decades. It is sadly not cheap, thus big companies, but I like it because the users do not have to do anything at all, it connects through an encrypted client for access, and backup media is never connected to any user’s computer. It is also a server pull solution rather than a client push, so (nearly) impossible for a user machine to infect the backup server, especially since files are transferred encrypted and always as data to the backup drive, and never executed.)  It does network backup, and runs on a connected server with only LAN access. (And an occasionally remote user if needed, adding a specific firewall rule.) That server has all inbound traffic blocked, so it can only pull in data.  I run a personal copy at home to protect my home and wife’s business. I scripted a system that un-mounts and uses a power line controller to turn on and off a set of arrays, so I get a rotational stack of drives with only one array connected at a time. Serious overkill, but after being attacked by ransomware, I am paranoid now. This is in addition to Carbonite and Dropbox cloud backup. 

Maybe too much?  🤔

Userlevel 7
Badge +25

My Mac makes backups every hour (Time Machine). Once a month I’ll use SuperDuper to backup and clone the Mac. I also backup on a flash drive, plus I have a backup on iCloud.

~ Backup ~ Backup ~ Backup ~ 😀

Oh, I forgot, I also have TimeMachine on our Macs. Yea, that too!  ;-)

Userlevel 5
Badge +1

Have you ever experienced a severe data disaster?

I would call my personal 2TB failure a data disaster because it’s happened at least 3 times in the timespan of 6 years and I never had a backup solution because I was too lazy.. but realised I lost a lot old gems

 

What was the catalyst that led to you adopting a backup solution?

Realizing that I really need to stop being lazy because it only leads to carelessness and myself to blame for losing precious files!

 

Do you use cloud or local backups?

Local backups to a NAS Synology device

Userlevel 7
Badge +25

Do you use cloud or local backups?

Local backups to a NAS Synology device

One reason to also have a remote backup is disaster recovery. Earthquake, fire, flood, or burglary (for examples) can take out both your machine and it’s backup if stored in the sane location.
 

For people who do not want to use the cloud as the alternate (I’ve heard a lot of reasons), I suggest a rotating local device that gets swapped with another every ‘n’ days with your work location or a friends house that is a distance away. ‘n’ depends on how much of a loss you are willing to accept vs the hassle of swapping the backup device all the time. You may never need it. But if you do, it’s a life saver. 

Userlevel 7
Badge +4

Datto has got to have one of the best DR system available it got tons of service for Enterprise to SMB solution wouldn't consider using anything else when it come to DR and Backups 

Yes and their SaaS protection is decent as well.

Userlevel 3

At home, I have a 2nd encrypted HDD and perform a daily backup on the important staff (images and docs).

 

At work we have daily incremental backups to a backup server and one offsite backup to another vendor. 

 

Thankfully I never faced a data disaster. A customer of ours at work had a ransomware once and we needed to restore his vm the previous state.

Userlevel 4

So far our work has been lucky and our backups have always worked OK, my wife personally doesn’t trust every online backup option and saves all of our pictures of my son on various memory sticks twice, keeping them in a box.  I think she’d print them so she had a hardcopy if I let her!

Userlevel 6
Badge +1

A few years ago a customer experienced a severe ransomware attack in which the backup to disk was also infected and encrypted. Thanks to (what some believe was old-fashioned) tape backup we were able to restore the environment in a few hours for the most important parts, with the rest in the week after that. I use this real-life example to explain the importance of offline backup.

Userlevel 3

Cloud backup and DPM solution
 

 

Userlevel 7
Badge +6

A few years ago we had a customer’s office burn down. Since we had backups, we were able to spin up the servers in the cloud and get everyone up and running in a few hours.

Reply