Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8382

Remove chunkSize and initialize from erasure coder

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Per discussion in HDFS-8347, we need to support encoding/decoding variable width units data instead of predefined fixed width like chunkSize. Have this issue to remove chunkSize in the general raw erasure coder API. Specific coder will support fixed chunkSize using hard-coded or specific schema customizing way if necessary, like HitchHiker coder.

      Update: per discussion in this issue, this will also remove initialize method from erasure coders. The necessary initialization work will be done in constructors.

      Attachments

        1. HDFS-8382-HDFS-7285-v1.patch
          63 kB
          Kai Zheng
        2. HDFS-8382-HDFS-7285-v2.patch
          14 kB
          Kai Zheng
        3. HDFS-8382-HDFS-7285-v3.patch
          26 kB
          Kai Zheng
        4. HDFS-8382-HDFS-7285-v4.patch
          42 kB
          Kai Zheng
        5. HDFS-8382-HDFS-7285-v5.patch
          42 kB
          Kai Zheng
        6. HDFS-8382-HDFS-7285-v6.patch
          43 kB
          Kai Zheng

        Issue Links

          Activity

            People

              drankye Kai Zheng
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: