Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8382

Remove chunkSize and initialize from erasure coder

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Per discussion in HDFS-8347, we need to support encoding/decoding variable width units data instead of predefined fixed width like chunkSize. Have this issue to remove chunkSize in the general raw erasure coder API. Specific coder will support fixed chunkSize using hard-coded or specific schema customizing way if necessary, like HitchHiker coder.

      Update: per discussion in this issue, this will also remove initialize method from erasure coders. The necessary initialization work will be done in constructors.

      Attachments

        1. HDFS-8382-HDFS-7285-v6.patch
          43 kB
          Kai Zheng
        2. HDFS-8382-HDFS-7285-v5.patch
          42 kB
          Kai Zheng
        3. HDFS-8382-HDFS-7285-v4.patch
          42 kB
          Kai Zheng
        4. HDFS-8382-HDFS-7285-v3.patch
          26 kB
          Kai Zheng
        5. HDFS-8382-HDFS-7285-v2.patch
          14 kB
          Kai Zheng
        6. HDFS-8382-HDFS-7285-v1.patch
          63 kB
          Kai Zheng

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            drankye Kai Zheng
            drankye Kai Zheng
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment