Monday, June 9, 2014

HDFS Raid at Facebook

Facebook deployed is HDFS RAID, an implementation of Erasure Codes in HDFS to reduce the replication factor of data in HDFS.

It maintains data safety by creating four parity blocks for every 10 blocks of source data. It reduces the replication factor from 3 to 1.4.

link:
https://code.facebook.com/posts/536638663113101/saving-capacity-with-hdfs-raid/

No comments:

Post a Comment