Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8059

Erasure coding: revisit how to store EC schema and cellSize in NameNode

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • HDFS-7285
    • None
    • None
    • None

    Description

      Move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile, and store them in FileWithStripedBlocksFeature.
      Ideally these two nums are the same for all striped blocks in a file, and store them in BlockInfoStriped will waste NN memory.

      Attachments

        Issue Links

        duplicates

        Sub-task - The sub-task of the issue HDFS-8833 Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

        • Major - Major loss of function.
        • Resolved
        requires

        Sub-task - The sub-task of the issue HDFS-8058 Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hitliuyi Yi Liu Assign to me
            hitliuyi Yi Liu
            Votes:
            1 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment