Distributed Storage with Compressed (1 out-of N) Codes

Abstract

Deletion-tolerant codes provide data availability despite storage failures and are commonly used for disk arrays and reliable storage in distributed systems. The codes used for that base on binary parity or on sophisticated cyclic codes with minimal storage overhead. But the calculations for these codes cause either a noticeable number of computation cycles or require a huge number of logic gates. In this paper, a different class of deletion-tolerant codes - (1 out-of N) codes - are analyzed with a focus on their application for distributed storage systems. It is shown that these codes when combined with compression can provide nearly the same low storage overhead as the traditional codes and allow a proper parallelization. Several variants of the code within the design space are discussed. (1 out-of N) codes are compared with parity codes in terms of required time for en- and decoding and their space requirements for parallel logic operations. An integration into a protocol for a distributed storage system is outlined.

Original languageEnglish
Title of host publication15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07)
Number of pages10
PublisherIEEE
Publication date13.08.2007
Pages179-188
Article number4135276
ISBN (Print)0-7695-2784-1
DOIs
Publication statusPublished - 13.08.2007
Event15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing
- Naples, Italy
Duration: 07.02.200609.02.2006
Conference number: 70053

Fingerprint

Dive into the research topics of 'Distributed Storage with Compressed (1 out-of N) Codes'. Together they form a unique fingerprint.

Cite this