My Big Scare with a NAS...

[nicoff]

I got a big scare with my NAS.

A few days ago I get a notification from my NAS (Drobo) telling me that one of the 5 drives failed. The Drobo holds my entire music library.

No big deal I think. I decided that since the existing drives are old and prices have come way down, I should replace not one but two drives with bigger ones.

Last evening the two new 6T drives arrive. They will be replacing two fairly old 1T drives. First I remove the damaged drive and insert a new one. The Drobo lights flash red indicating that the new drive is not working properly. Shoot.

Thinking that maybe I zapped the new drive I decided to swap it with the second new drive.

In my quest to do it quickly, I pushed the wrong button and removed one of the still working 1T drives. Now I only have three 1T drives in the unit and the Drobo goes crazy with all lights flashing yellow! And a "Critical" warning sign on the computer. All I can think of is 'Oh s***t'.

I managed to install the two new drives. The Drobo announces that it will take 17 hours to complete the installation. Meanwhile the Drobo has disappeared from the directory and the yellow and green lights continue to flash.

Five hours later (glad that it did not take all 17 hours) the process is completed. I try to connect the Drobo to the computer but nothing happens. The Drobo will not connect and is not shown anywhere. I restart the computer and the Drobo, again nothing happens.

Then I look at the capacity of the Drobo and it appear as if the drives are almost empty. I am like, 'where did my data go?'

More research makes me realize that I should have only replaced one drive at a time. I read about a repair tool within the Drobo. After a whole bunch of 'Proceed with caution' and other warnings is when I finally realized that I really messed up. The Drobo announces that it started the repair. The fine print says that "the repair may run for several days, weeks or months" and you will not see any indicators that show progress and I think...'Oh S***t'.

In the middle of the night I realized that last month I had cancelled my automatic cloud backup and had asked my wife to copy the Drobo files to her cloud drive. This morning I replace the usual good morning with 'Did you copy the Drobo files to your cloud drive?" and she replies 'what is Drobo?' and I am like O-H S***T!

By midday today I realize that all the hours/days that I spent ripping my music collection is likely gone. Just the thought of having to do it all over again gives me pain. I wonder what else did I have in the Drobo that is gone too.

At about 6pm today, nearly 24 hours after the ordeal started, the Drobo announces that the repair is complete and that I need to restart the Drobo. Still nothing shows connected to the computer. I cautiously restart the Drobo and a few minutes later... voila. The Drobo and all the files reappear as if nothing happened.

Boy I was lucky. I just finished making a copy of the Drobo to a cloud drive. :celebrate008_2:

 

[joeinid]

You certainly were lucky!

Always backup first and replace failed/old drives one at a time until the unit is fully rebuilt after each replacement. Thank goodness.

 

[Oly]

Whew! Disaster averted.

 

[still-one]

I have been using computers since the early 80's and have never had a drive fail. I back up nothing other than what OSX does which has zero music on it. I figure if my drive fails I will just load the music I listen to again. It will just save me a music cull.

 

[nicoff]

I have been using computers since the early 80's and have never had a drive fail. I back up nothing other than what OSX does which has zero music on it. I figure if my drive fails I will just load the music I listen to again. It will just save me a music cull.

The two drives that I replaced were manufactured in 2010 and 2011. That's 8 or 9 years running pretty much full time. I think that is likely to be much more usage than most folks use.

 

[Hounddog]

I have been using computers since the early 80's and have never had a drive fail. I back up nothing other than what OSX does which has zero music on it. I figure if my drive fails I will just load the music I listen to again. It will just save me a music cull.

You’re lucky. I’ve had two fail, one of which cost me $600 to have restored and the second I had backed up (because of the lesson I learned on the first one). Now, I have the NAS, amazon drive (cloud) and everything on a hard drive that I store at the office. In addition to my music, I have about 40,000 photos that I care an awful lot about.


Sent from my iPad using Tapatalk Pro

 

[jdandy]

Real men don't need no stinking manual. .

 

[Randy Myers]

Yes I would say you were lucky. In a Raid configuration always replace one at a time to allow the NAS to reconfigure itself across the drives.

I keep all my music on my server but I do retain three backups of all my files, one on a network drive and two on external drives (one external has full backup and the other which is smaller only has the most important files, music and photos )

 

[nicoff]

Three of the original drives are still in the unit. Like the one that failed, they must be 8-9 years. That means that they could also fail at any time. So I just selected "Dual Disk Redundancy" in the Drobo settings. That setting uses up more space but data is kept safe even if two hard drives fail. Better safe than sorry!

 

[Randy Myers]

Better safe then sorry. If you plan it out right there is no reason you could not replace all of the drives, one at a time... right... this would give you all fresh drives if this is a major concern for you.

 

[nicoff]

Better safe then sorry. If you plan it out right there is no reason you could not replace all of the drives, one at a time... right... this would give you all fresh drives if this is a major concern for you.

Very good points Randy.

This has led me to an interesting discovery. I had five 1T drives (5T raw). I replaced two of them with two 6T drives and ended up with 15T raw. So the net raw added capacity is 10T.

Yet net increase in available space for data is only 4.54T. Where did all the added raw capacity go?

The Drobo calculator confirmed that the efficiency changed from 72.3% (all disks the same size) to about 55% (three 1T plus two 6T). [emoji15]

If I had read the manual (thank you jdandy! [emoji51]) I should have replaced all five disks with same size disks to keep the same efficiency level.

Needless to say, I will be replacing the three remaining old drives with new ones. I already notice and Improvement in acceding the data. This is expected since the new drives are much faster and have bigger cache.

 

[MikeCh]

Good to know you got it recovered OK!

Back about 10 years ago when I used to manage servers and storage at an enterprise class level, RAID Storage replacements did require drives to be similar size across the RAID (at least that's what we followed). Perhaps technology has changed to allow disimilar sized hard drives within the RAID? If so, the parity striping (the bits and pieces that allow a drive to be rebuilt from the data spread across the other drives) may be taking more resources and creating the inefficiency values that you now see....????

This is just my speculation (if the technology exists) that having disimilar drives creates more work for the intelligence of the RAID drive array (also eats up more space to store that parity info) and hence a bit lower efficiency for storage and retrieval.

 

[Randy Myers]

Very good points Randy.

This has led me to an interesting discovery. I had five 1T drives (5T raw). I replaced two of them with two 6T drives and ended up with 15T raw. So the net raw added capacity is 10T.

Yet net increase in available space for data is only 4.54T. Where did all the added raw capacity go?

The Drobo calculator confirmed that the efficiency changed from 72.3% (all disks the same size) to about 55% (three 1T plus two 6T). [emoji15]

If I had read the manual (thank you jdandy! [emoji51]) I should have replaced all five disks with same size disks to keep the same efficiency level.

Needless to say, I will be replacing the three remaining old drives with new ones. I already notice and Improvement in acceding the data. This is expected since the new drives are much faster and have bigger cache.

I am definitely not an expert in RAID and NAS setups, however during the past 6 months I have purchased a new NAS and a new Server for work. Both are using RAID 5 which require a minimal of three equal drives. Both QNap and Dell told me that all drives in the RAID require being the same size for the RAID to work correctly.

I do not know for sure, but I am guessing if you added a different size drives into the mix the RAID may not be reading it correctly???? It sounds like one of the new drives is being read as the same size as the original drives, 1T, to make the RAID work, and therefore your additional space would be closer to what you are saying that you are seeing. Again, I am only speculating here.

 

[octadyndude]

Nicoff not sure what level of raid you're running. What was your total storage with just the 5 - 1TB drives? Anyhow when you get get the 3 remaining drives I would suggest the following. Shut down the Nas logically. When it's off pull only 1 1tb drive and power it up again. Let it see the missing drive and shut it down again. Now add 1 new drive. Bring it back up and let the Nas do its thing. Once that completed do the same thing 1 drive at a time. Check your total capacity each time too.

5 drives in a raid doesn't make sense to me unless the 5th drive is configured as a 'hot swap". Hot swap being a drive that is formatted ready to use making the rebuild time shorter. Here is a link to raid configurations.

https://www.prepressure.com/library/technology/raid

 

[nicoff]

Thank you guys!
Drobo advertised that their technology is not the traditional Raid technology.

This is from their site: "Drobo connects to your computer or network and provides redundant data protection without the complexities of traditional RAID."

I have confirmed that Drobo allows you to have drives of different sizes but the cost is lower efficiency.

Here are three examples:
With five 1T drives:

With two 6T drives and three 1T drives.

And just another with four different sizes.

The system works. Now I need to buy three more drives. I am considering buying drives with 4T capacity. That will give me 16.34T capacity.

If I go with five 6T, I get 21.78TB.

You can do a hot swap with any of the drives. But it has to be done one at a time, unless I select "dual disk redundancy" which means that two drives can fail at the same time and the data remains protected. Of course, the disk redundancy makes less data available for storage.

 

[wisnon]

I got a big scare with my NAS.

A few days ago I get a notification from my NAS (Drobo) telling me that one of the 5 drives failed. The Drobo holds my entire music library.


Boy I was lucky. I just finished making a copy of the Drobo to a cloud drive. :celebrate008_2:

What no physical backup???

I have an offline physical backup for my 16tb of music, net 16tb after duplications.

 

[wisnon]

Yes I would say you were lucky. In a Raid configuration always replace one at a time to allow the NAS to reconfigure itself across the drives.

I keep all my music on my server but I do retain three backups of all my files, one on a network drive and two on external drives (one external has full backup and the other which is smaller only has the most important files, music and photos )

I don't use RAID...waste of space. Physical backup...that is the way to go.

 

[Randy Myers]

I agree for personal use. In professional server environments it is essential that everything is redundant. Even hot swap power supplies.

However at home I use regular physical backups, as you see... actually three ...

 

[wisnon]

I agree for personal use. In professional server environments it is essential that everything is redundant. Even hot swap power supplies.

However at home I use regular physical backups, as you see... actually three ...

Agreed. I don't do regular backup though, I do bull redundancy that is never turned on again except if I ever need to restore, and only then. They suffer no wear and tear as they are never energised.

 

[nicoff]

I just noticed that two of the three remaining old drives have a "warning" sign. That is an indication that they can fail any moment.

I ordered three new 6T drives yesterday (decided to keep all of them the same size). Meanwhile, I have backed up all my music files to the cloud and have selected dual disk redundancy in the Drobo. With dual disk redundancy two drives can fail at the same time and I am still protected.

I am amazed at how much faster the new drives respond when moving, copying, pasting. I assume that the same applies to data transfer when streaming. However, there is no difference in the sound when streaming from the NAS (I was not expecting any change either).