We propose to implement Erasure Coding in Apache Ozone to provide efficient storage. With EC in place, Ozone can provide same or better tolerance by giving 50% or more storage space savings.
In HDFS project, we already have native codecs(ISAL) and Java codecs implemented, we can leverage the same or similar codec design.
However, the critical part of EC data layout design is in-progress, we will post the design doc soon.
HDDS-5351, which has a bunch of pre-requisites for the EC feature committed directly to the master branch.