Resend my activation email : Register : Log in 
BCF: Bike Chat Forums


Storage

Reply to topic
Bike Chat Forums Index -> The Geek Zone Goto page 1, 2  Next
View previous topic : View next topic  
Author Message

toby1
Scooby Slapper



Joined: 02 Aug 2011
Karma :

PostPosted: 11:19 - 01 Feb 2019    Post subject: Storage Reply with quote

Here's the thing. I have a few terabyte of precious music files spread over a main computer and external drives.

I want to put these in one place so I started to read about external storage. I looked at say a 4tb drive and thought a decent make like seagate would do it. However reading about drives in general there is a failure figure on new drives of almost 27% in the first year, the general lifespan is 3 to 4 years, and the concensus is that all hard drives will eventually fail - they have a finite lifespan.

So how can I save my music?. I could get paranoid and buy backup drives for backup drives in an infinitive loop? Would the cloud be a safe place - or will I eventually loose my music collection as there is no real long term solution?

?
 Back to top
View user's profile Send private message You must be logged in to rate posts

doggone
World Chat Champion



Joined: 20 May 2004
Karma :

PostPosted: 11:32 - 01 Feb 2019    Post subject: Reply with quote

Even cloud storage is not without risk but should be part of your solution.
I suspect anything stored on google drive should be as a safe as anywhere.
Otherwise duplicated and carefully stored external drives, ideally not kept in the same location are as good as anything. Even if it somehow would not fire up there would be a way to recover data.

I suspect the fail rates are with regular or even constant use.I've got a 'cheap' seagate portable 500Gb attached to the router so it networks, and it has been running for 5 years.
Important stuff is duplicate elsewhere, but it's a quick way to make a second copy almost immediately, or at least same day.
 Back to top
View user's profile Send private message Visit poster's website You must be logged in to rate posts

MCN
Super Spammer



Joined: 22 Jul 2015
Karma :

PostPosted: 11:40 - 01 Feb 2019    Post subject: Reply with quote

Pish.
____________________
Disclaimer: The comments above may be predicted text and not necessarily the opinion of MCN.


Last edited by MCN on 13:03 - 01 Feb 2019; edited 1 time in total
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

toby1
Scooby Slapper



Joined: 02 Aug 2011
Karma :

PostPosted: 11:42 - 01 Feb 2019    Post subject: Reply with quote

I may be overthinking this - but if I archived to a disc that didn't fire up I probably could retrieve the data - but to where for permanent access ? As you stated the cloud is not 100%, neither is any form of storage - ever.

Unless data is constantly moved and restored it will eventually be lost.
 Back to top
View user's profile Send private message You must be logged in to rate posts

linuxyeti
World Chat Champion



Joined: 06 Oct 2006
Karma :

PostPosted: 11:47 - 01 Feb 2019    Post subject: Reply with quote

Just have 2 backup disks, and rotate backups to them..
____________________
Beware what photos you upload, or link to on here, especially if you have family members on them
 Back to top
View user's profile Send private message You must be logged in to rate posts

Im-a-Ridah
World Chat Champion



Joined: 20 Oct 2006
Karma :

PostPosted: 11:51 - 01 Feb 2019    Post subject: Reply with quote

Microsoft or Google are safe cloud providers but its slow to upload and there is a monthly cost.

As for drives you can protect against drive loss with data redundancy using a RAID system i.e 3 drives set up in RAID 5 to recover from one drive dying. The second issue is backups, which protects against someone robbing your house or something. For this get an external USB drive and store it at a relative's place. Cloud is another alternative as a backup and would protect against almost any threat. It all depends how much you want to spend on the protection. As a backup the main downside of cloud is that its a recurring cost for something you might never use, whereas a USB backup drive is a single fixed cost, and you keep the protection if you stop paying.

Cheap: 1 drive for local storage + 1 USB external backup
Medium: 1 drive for local storage + 1 cloud backup
Expensive: 3 drive local RAID + 1 cloud backup
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

The Shaggy D.A.
Super Spammer



Joined: 12 Sep 2008
Karma :

PostPosted: 12:01 - 01 Feb 2019    Post subject: Reply with quote

https://vinylrecorder.com/order.html Thumbs Up
____________________
Chances are quite high you are not in my Monkeysphere, and I don't care about you. Don't take it personally.
Currently : Royal Enfield 350 Meteor
Previously : CB100N > CB250RS > XJ900F > GT550 > GPZ750R/1000RX > AJS M16 > R100RT > Bullet 500 > CB500 > LS650P > Bullet Electra X & YBR125 > Bullet 350 "Superstar" & YBR125 Custom > Royal Enfield Classic 500 Despatch Limited Edition (28 of 200) & CB Two-Fifty Nighthawk > ER5
 Back to top
View user's profile Send private message You must be logged in to rate posts

toby1
Scooby Slapper



Joined: 02 Aug 2011
Karma :

PostPosted: 12:12 - 01 Feb 2019    Post subject: Reply with quote

The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?

External USB drives have a finite life The cloud has a backup system why can that not fail? - again even a backup system to backup a system is a system set to fail at some point in it's stated lifetime? After all isn't the whole point of a backup system there because we know the primary system may fail? and so the backup cannot be any different. If it was better it would be the primary system and so on?

Not trying to be pedantic on this, certainly storage can and will last for years, but can't forever the law of averages will mean at some point a failure will claim the data., As I said unless constantly moved and refreshed and duplicated all data will eventually be lost. Food for thought.
 Back to top
View user's profile Send private message You must be logged in to rate posts

Riejufixing
World Chat Champion



Joined: 24 Jun 2018
Karma :

PostPosted: 12:50 - 01 Feb 2019    Post subject: Reply with quote

toby1 wrote:
The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?

8<

As I said unless constantly moved and refreshed and duplicated all data will eventually be lost. Food for thought.

RAID systems don't recover data from dying drives, they have redundant drives so that if one (possibly more) fail, then the data is still available on other non-failed disk(s). The failed or failing storage is replaced, and the RAID system "resynchronises" data onto the new disk to recover redundancy. There's an obvious timing issue here, not to mention other possible issues.

RAID originally meant "Redundant Array of Inexpensive Disks". Marketing I guess corrupted that to "Redundant Array of Independent Disks", but with RAID storage the same saying still holds true: "Fast, cheap, reliable: pick any two".

Yes, data storage does have to be kept up-to-date. Think how hard it would be for instance to recover data off (say) an old '70s removable-media disk (54 megaword) drive, or old 9-track 1/2" tape. Pfffft!
 Back to top
View user's profile Send private message You must be logged in to rate posts

Im-a-Ridah
World Chat Champion



Joined: 20 Oct 2006
Karma :

PostPosted: 13:01 - 01 Feb 2019    Post subject: Reply with quote

toby1 wrote:
The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?

External USB drives have a finite life The cloud has a backup system why can that not fail? - again even a backup system to backup a system is a system set to fail at some point in it's stated lifetime? After all isn't the whole point of a backup system there because we know the primary system may fail? and so the backup cannot be any different. If it was better it would be the primary system and so on?

Not trying to be pedantic on this, certainly storage can and will last for years, but can't forever the law of averages will mean at some point a failure will claim the data., As I said unless constantly moved and refreshed and duplicated all data will eventually be lost. Food for thought.


Drives don't die that quickly. If you are that concerned then just use a bigger RAID with even more redundancy against 2 drive failures and multiple backups. Also the backups are very unlikely to die as they aren't in use. The data can be as safe as you want to pay for really.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

MCN
Super Spammer



Joined: 22 Jul 2015
Karma :

PostPosted: 17:06 - 01 Feb 2019    Post subject: Reply with quote

I have Tbs and Tbs of 'valuable' shite on several external drives and sticks.

I was advised by a cool IT manager that one should be careful with storage.
Probably fine to ram (no Pun) everything on one device to be convenient but if it dies recovery is difficult.

Dropping the bastirts is usually death.

Opening them (and then separating the discs) is mental/autisic. Embarassed

The multi-disc devices have the discs VERY precisely aligned using expensive specialist equipment.

My tool at the moment is a WD - My Passport External SSD - 1 TB. It's very fast and up to now has performed flawlessly.

I spread my shit/my shit is spread over several drives.
I mainly use at work to keep history of jobs as the company system is pish.
____________________
Disclaimer: The comments above may be predicted text and not necessarily the opinion of MCN.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

MarJay
But it's British!



Joined: 15 Sep 2003
Karma :

PostPosted: 17:17 - 01 Feb 2019    Post subject: Reply with quote

Buy a Synology 2 bay NAS, set it for RAID 1.

Done and done.

Then when one drive fails you swap it for a new one, rebuild and then when the second one dies, replace it and rebuild. Rinse and repeat.

I think it's pretty sad that in the Geek zone so many people who responded with supposedly knowledgable answers actually have no clue how a RAID array works. ([Edit]with notable exceptions! I realised I basically said the same as I'm-a-Ridah Smile )

I've replaced pretty much all drives in a RAID 10 6 drive array, and the data has been fine - not all at the same time obviously but that's the point of it. It's extremely unlikely for a pair of drives to die at exactly the same moment, so you just replace one when it does. Theoretically it should mean that you keep the data forever.

However, there is an issue of a disaster such as a fire or burglary, in which case you also want off-site backups, but it really does depend on how wedded you are to the data.


It's also worth noting that I have a NAS I bought in 2006 that is still working, and one of the drives is original. I replaced the other about five years ago and that is still going too.
____________________
British beauty: Triumph Street Triple R; Loony stroker: KR1S; Track fun: GSXR750 L1; Commuter Missile: GSX-S1000F
Remember kids, bikes aren't like lego. You can't easily take a part from one bike and then fit it to another.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

Riejufixing
World Chat Champion



Joined: 24 Jun 2018
Karma :

PostPosted: 17:23 - 01 Feb 2019    Post subject: Reply with quote

MarJay wrote:
I think it's pretty sad that in the Geek zone so many people who responded with supposedly knowledgable answers actually have no clue how a RAID array works.


Exactly what do you see as problems? That "multi-disc devices have the discs VERY precisely aligned", or something else?
 Back to top
View user's profile Send private message You must be logged in to rate posts

MarJay
But it's British!



Joined: 15 Sep 2003
Karma :

PostPosted: 17:55 - 01 Feb 2019    Post subject: Reply with quote

Riejufixing wrote:
MarJay wrote:
I think it's pretty sad that in the Geek zone so many people who responded with supposedly knowledgable answers actually have no clue how a RAID array works.


Exactly what do you see as problems? That "multi-disc devices have the discs VERY precisely aligned", or something else?


Dunno, but that's nonsense in itself.

I wasn't going to name names, seems pointless and it should be self evident anyway.
____________________
British beauty: Triumph Street Triple R; Loony stroker: KR1S; Track fun: GSXR750 L1; Commuter Missile: GSX-S1000F
Remember kids, bikes aren't like lego. You can't easily take a part from one bike and then fit it to another.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

Im-a-Ridah
World Chat Champion



Joined: 20 Oct 2006
Karma :

PostPosted: 18:39 - 01 Feb 2019    Post subject: Re: Storage Reply with quote

Also generally when they say 5 year life they mean 5 years of operation, rather than simply 5 years after production! Think "flight hours" rather than "shelf life". If you used it at work for 8 hours a day, every day, it should be good for 15 years. I wouldn't recommend it, but in theory...
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

Riejufixing
World Chat Champion



Joined: 24 Jun 2018
Karma :

PostPosted: 19:09 - 01 Feb 2019    Post subject: Reply with quote

MarJay wrote:
Riejufixing wrote:

Exactly what do you see as problems? That "multi-disc devices have the discs VERY precisely aligned", or something else?


Dunno, but that's nonsense in itself.

I wasn't going to name names, seems pointless and it should be self evident anyway.


Oh, I don't know, discussion isn't - or shouldn't be - about running anyone down, just discussing and hopefully informing.

That bit about "fire or burglary, in which case you also want off-site backups"... reminds me of a place I worked where a local computer room was run from a portakabin, and they were rigorous about backups. The tapes, in that case, were kept in the same room, which would have been fine had the large pump just outside not malfunctioned, sending part of itself through the portakabin, and burning the whole thing to ashes.... oh dear. Oh dear oh dear.
 Back to top
View user's profile Send private message You must be logged in to rate posts

MarJay
But it's British!



Joined: 15 Sep 2003
Karma :

PostPosted: 21:46 - 01 Feb 2019    Post subject: Reply with quote

Ok this is the primary line that triggered my prattishness...

Quote:
The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?

____________________
British beauty: Triumph Street Triple R; Loony stroker: KR1S; Track fun: GSXR750 L1; Commuter Missile: GSX-S1000F
Remember kids, bikes aren't like lego. You can't easily take a part from one bike and then fit it to another.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

Ste
Not Work Safe



Joined: 01 Sep 2002
Karma :

PostPosted: 22:11 - 01 Feb 2019    Post subject: Reply with quote

Replace the terabytes of music files with a Spotify account and you'll never have to worry about backing stuff up ever again.

"in general there is a failure figure on new drives of almost 27% in the first year"

No there isn't. Razz
 Back to top
View user's profile Send private message You must be logged in to rate posts

Riejufixing
World Chat Champion



Joined: 24 Jun 2018
Karma :

PostPosted: 22:17 - 01 Feb 2019    Post subject: Reply with quote

MarJay wrote:
Ok this is the primary line that triggered my prattishness...
Quote:
The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?


Smile Well it's sort-of right in a way, in that the drives will eventually fail; but your point is that they should be replaced as and when....
 Back to top
View user's profile Send private message You must be logged in to rate posts

MarJay
But it's British!



Joined: 15 Sep 2003
Karma :

PostPosted: 22:31 - 01 Feb 2019    Post subject: Reply with quote

Riejufixing wrote:
MarJay wrote:
Ok this is the primary line that triggered my prattishness...
Quote:
The wider picture. The RAID system recovering a dying drive - the drive died so why will the backup drives set to recover also not die - ad infinitum.?


Smile Well it's sort-of right in a way, in that the drives will eventually fail; but your point is that they should be replaced as and when....


My point is that RAID accounts for the likelihood of failure of a drive.

Each drive type will have a mean time to failure. Some will do better than that, some will do worse but usually there is a curve and it's INCREDIBLY unlikely that two drives will fail at the same time.

As I used to tell my customers: "The RAID system is designed to monitor the performance specifications of every drive and compare it to it's peers. If any of those specifications moves out of bounds when compared with it's peers, the system will pre-emptively fail the drive. If another drive starts throwing errors, often the system will not fail this second drive until the first one is rebuilt. Drives that throw errors do not necessarily indicate a hardware failure, rather a drop off in performance. This means that you have some safety margin to swap the failed drive, but you should do so as soon as you have obtained a replacement. It is not uncommon for a replacement drive procedure to trigger a second drive failure for the reasons outlined above. This drive failure will only occur once the first drive rebuild is complete"

Most home NAS's probably have different failure thresholds to our broadcast critical playout server NAS architecture, but it will work in a similar way.
____________________
British beauty: Triumph Street Triple R; Loony stroker: KR1S; Track fun: GSXR750 L1; Commuter Missile: GSX-S1000F
Remember kids, bikes aren't like lego. You can't easily take a part from one bike and then fit it to another.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

iooi
Super Spammer



Joined: 14 Jan 2007
Karma :

PostPosted: 22:36 - 01 Feb 2019    Post subject: Re: Storage Reply with quote

toby1 wrote:
However reading about drives in general there is a failure figure on new drives of almost 27% in the first year, the general lifespan is 3 to 4 years, and the concensus is that all hard drives will eventually fail - they have a finite lifespan.


?



Makes great reading....

Of course any drive can fail at any point.
Better to keep running, than keep switching off and on all the time.
____________________
Just because my bike was A DIVVY, does not mean i am......
 Back to top
View user's profile Send private message You must be logged in to rate posts

Pigeon
World Chat Champion



Joined: 27 Sep 2012
Karma :

PostPosted: 22:58 - 01 Feb 2019    Post subject: Reply with quote

linuxyeti wrote:
Just have 2 backup disks, and rotate backups to them..


Agree. Redundancy limits risk.

Original + 1 copy on-site + 1 copy off-site.
 Back to top
View user's profile Send private message You must be logged in to rate posts

Im-a-Ridah
World Chat Champion



Joined: 20 Oct 2006
Karma :

PostPosted: 13:16 - 02 Feb 2019    Post subject: Reply with quote

Pigeon wrote:
linuxyeti wrote:
Just have 2 backup disks, and rotate backups to them..


Agree. Redundancy limits risk.

Original + 1 copy on-site + 1 copy off-site.


Just to add, the off-site copy doesn't have to be really up to date. It's just about damage limitation. It's better to lose 1 year of data than everything.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

P.
Red Rocket



Joined: 14 Feb 2008
Karma :

PostPosted: 21:10 - 02 Feb 2019    Post subject: Reply with quote

Depending on your cash, M-Discs are 100+ year life. Got a few at work.

Otherwise decent NAS, few low speed drives in RAID1, not a problem.
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts

Andy_Pagin
World Chat Champion



Joined: 08 Nov 2010
Karma :

PostPosted: 12:09 - 03 Feb 2019    Post subject: Reply with quote

I keep all my precious stuff on a server at work, can't get any safer since it's all virtualised at a data centre. So if you're in a reasonably secure job with a company that has those facilities you could ask your IT guys nicely.
____________________
They're coming to take me away, ho-ho, hee-hee, ha-haaa, hey-hey,
the men in white coats are coming to take me away.
Yamaha Vity -> YBR125 -> FZS600 Fazer -> FZ1-S Fazer
 Back to top
View user's profile Send private message Send e-mail You must be logged in to rate posts
Old Thread Alert!

The last post was made 5 years, 77 days ago. Instead of replying here, would creating a new thread be more useful?
  Display posts from previous:   
This page may contain affiliate links, which means we may earn a small commission if a visitor clicks through and makes a purchase. By clicking on an affiliate link, you accept that third-party cookies will be set.

Post new topic   Reply to topic    Bike Chat Forums Index -> The Geek Zone All times are GMT + 1 Hour
Goto page 1, 2  Next
Page 1 of 2

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Read the Terms of Use! - Powered by phpBB © phpBB Group
 

Debug Mode: ON - Server: birks (www) - Page Generation Time: 0.08 Sec - Server Load: 0.17 - MySQL Queries: 17 - Page Size: 141.86 Kb