Recent Changes - Search:


Code:


Social:


My journals will take the place of a blog. If you go to the Journal page there is an RSS feed to subscribe with.

« July 2017 
SunMonTueWedThuFriSat
      1
2345678
9101112131415
16171819202122
23242526272829
3031     

Sites I take responsibility for

West Volusia, Florida

Documents

Technical

General

Me

Living

Places I frequent

Hobbies

Humor

Items for sale:


Clipboard

edit SideBar

My thoughts on archiving

Include our styles below Infobox - invoke as >>infobox<< ... >><<

Codebox: - invoke as >>codebox<< ... >><<

warnbox: - invoke as >>codebox<< ... >><<

editingbox: - invoke as >>codebox<< ... >><<

noticebox: - invoke as >>codebox<< ... >><<

Page bread crumbs: Welcome to ke3vin.org! - My Thoughts - Archiving

Pages by tags: (:listtags:)
Subscribe to this wiki: RSS Feed RSS or subscribe to this page for changes: RSS Feed RSS
496 articles have been published so far. Recent changes
Share

2016-03-22: This site is being moved to my main site at https://kevininscoe.com/wiki as part of a consolidation to one domain.


I notice that my archiving needs are outstripping available rigid media. Best case a dual layer HD-DVD can hold about 30GB of storage while the highest density consumer grade magnetic tape (that is available today): LTO-4 is about 800 GB. While hard disk drives are cheaper then LTO-4 drives (especially when you include the media) they make a poor archival solution. First of all just making a drive and putting it on a shelf to sit idle is <b>not</b> what I call a trusted archive. The only way to determine if a drive has failed and when the platter is spinning. That is not very "green" for one thing chewing up energy for something you likely only need once in a while. And what do you do if the drive fails? That requires making a second drive for redundancy. You do this enough and you start talking RAID storage like RAID 5 or 6. Since I don't trust RAID with important data backups (which after all is what true archiving is all about) I don't like that option. You start doing options like RAID-10 and that starts getting expensive especially in the multiples of terabytes. So much so that you start looking again at the tape solution. And then there's the indexing. How do you find what tape holds what file. How do I even know what I file holds the data I am looking for? That today is my quandary. This page will reflect what I am finding out and what I am doing about it.

First some requirements:

I need to create a 5 TB fully redundant archive. Copies stored at the house and copies stored off-site such as a safe deposit box or a relatives house in another state in case of disaster. "Fully redundant" meaning at least two copies of each rigid media more preferably three or a mirrored running hard disk drive system such as a mirror+stripe (RAID-10).

Some notes:

http://en.wikipedia.org/wiki/MARC_standards

http://www.loc.gov/marc/

http://www.ilsa.lib.ia.us/marcfaq.htm

http://www.devon-technologies.com/products/devonthink/

http://oreilly.com/pub/a/mac/2005/08/26/devonthink.html

http://www.stevenberlinjohnson.com/movabletype/archives/000230.html

http://www.dspace.org/


Kevin's Public Wiki maintained and created by Kevin P. Inscoe is licensed under a
Creative Commons Attribution 3.0 United States License.

Back to my web site - http://kevininscoe.com

Edit - History - Print - Recent Changes - Search
Page last modified on September 16, 2011, at 04:25 PM EST