Distributed Backups?
from the another-solutions dept
Having lost way too many hard-drives in the last couple years, I've become pretty focused on backup systems, and (judging from a few conversations here at DEMOmobile) it's a subject that a lot of people are interested in. Bob Cringely's latest column is another one of his "big idea for a company" suggestions that he simply tosses out and hopes someone builds: a peer-to-peer distributed backup system. The idea is pretty simple. You download some backup software which encrypts the data you want to backup, breaks it up into little chunks and moves it out over a peer-to-peer network. The amount of data you can backup is limited by the amount you agree to store yourself. In Cringely's plan, this whole thing should cost $3.95/month. Of course, you'd need to distribute many copies of the various pieces to make sure that there aren't chunks missing -- which will also mean that many people will need to be in the system before it's really all that reliable. Obviously, some people will freak out about chunks of their data (even if they are encrypted) sitting on random hard drives out there). In the meantime, it appears Cringely doesn't use Google, because a quick search on the topic suggests at least some people are already working on this type of technology.
17 Comments | Leave a Comment..
- 'The Economist' And 'Financial Times' Already Writing Off ACTA As Dead
- Newspaper Boss Says Newspapers Need More Money... Because New Media Steals & May 'Destroy Civil Society'
- If The Internet Is Treated Just Like The Offline World, We'd Never Have Ridiculous Laws Like SOPA/PIPA
- Can Facebook Really Bring About A More Peer-to-Peer, Bottom-Up World?
- The Pirate Bay Press Release On SOPA: We Are The New Hollywood





Reader Comments (rss)
(Flattened / Threaded)
Delta
[ reply to this | link to this | view in thread ]
No Subject Given
I've tried Ghost 7/2003 and Acronis TrueImage6, but DriveImage7 (now owned by Symantec, and seems to be worked into Ghost9) seems to be the nicest so far, but still a little buggy (it's a known bug that if you tick the "checksum image when done" box, it will render the image useless).
I'd really like something that would work across Windows, and all the new journaled Linux filesystems, but haven't found anything that will do more than FAT32/NTFS/ext3.
The latest trend is allowing you to do the backup in Windows - which means you can write the image to any device, as you have the drivers (not some stupid DOS boot floppy).
Someone needs to write something that will just copy whatever is on a HDD (regardless of format) to any device you want (DVD-RW, HDD, LAN) just with a simple boot CD. It must however retain things like the boot sector, MBR, and partition information (you ever tried to ghost a dual booting drive?!)
I guess the best way is to just get one of those hardware drive duplicators, but they cost thousands and you need two identical drives.
[ reply to this | link to this | view in thread ]
quote
- Linus Torvalds
[ reply to this | link to this | view in thread ]
Onion Networks (Justin Chapweske)
Justin Chapweske (who authored SwarmCast, a key component of OpenCola's late, lamented plan for world domination) has done a lot of work that could be (or may have already been) applied to this. He likes distributing things.
I know it's probably something that most people know already, but just in case: it's also worth digging into "forward error correction" a bit as a mechanism for offsetting the impact of the "ensure that you aren't missing a key piece of your data" concerns.
[ reply to this | link to this | view in thread ]
You can buy this product already!
[ reply to this | link to this | view in thread ]
Done deal
[ reply to this | link to this | view in thread ]
Corporate Intelligence?
Still, the reality of the matter is that the lead time that hive cache had will soon be comming to a close. First group to successfully build a nice, well integrated windows protduct that they can sell out to Veritas or any one of the 10+ other backup product makers out there will win and become the new industry standard in backup...
Of course, when encrypted P2P hits the streets with anonymous distribution of keys via DNS, the RIAA is going to get a nifty little introducton to how the internet routes around damage.
[ reply to this | link to this | view in thread ]
Re: Corporate Intelligence?
[ reply to this | link to this | view in thread ]
P2P Backup
[ reply to this | link to this | view in thread ]
P2P Backup
[ reply to this | link to this | view in thread ]
Re: Corporate Intelligence?
private invitations for pre-release evaluation happened over a year ago.
dumbass...
[ reply to this | link to this | view in thread ]
Re: Corporate Intelligence?
Wow! A pre-release evaluation over a year ago, and they have nothing new to offer on their web site. Really promising stuff!
[ reply to this | link to this | view in thread ]
No Subject Given
There is also an optional off-site component to this, so that you can additionally backup to a remote server to protect against office wide failures like fire, theft, or hurricanes. Your backups are still encrypted, so the data is still secure. Present plans are to run the off-site servers for this as a paid service (with the p2p backup remaining free at least for version 1.0). However the server software is written in PHP and can easily be run on any commodity $3/month web-hosting service, and I might consider just releasing the server code for people to use on their own if there is an interest in that.
I would greatly appreciate any and all feedback on this program. I really want this program to evolve based on what users out there want, and I realize that the current version doesn't have every ideal feature, so I would love to hear what people would like to have added first. You can send me feedback at [email protected]
Thanks,
- Tim Macinta
[ reply to this | link to this | view in thread ]
Not exeactly the 3 bucks Cringley wants...
[ reply to this | link to this | view in thread ]
Re: Corporate Intelligence?
[ reply to this | link to this | view in thread ]
Re: Corporate Intelligence?
Check out
http://www.vembu.com/storegrid/desktop-backup.html
[ reply to this | link to this | view in thread ]
I made a system like this for a University project
It is extremely fault tolerant too since it uses correction codes.
[ reply to this | link to this | view in thread ]
Add Your Comment