Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-9040

Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-7285
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The general idea is to simplify error handling logic.

      Proposal 1:
      A BlockGroupDataStreamer to communicate with NN to allocate/update block, and StripedDataStreamer s only have to stream blocks to DNs.

      Proposal 2:
      See below the comment from Jing Zhao.

        Attachments

        1. HDFS-9040-HDFS-7285.007.patch
          123 kB
          Jing Zhao
        2. HDFS-9040-HDFS-7285.006.patch
          123 kB
          Jing Zhao
        3. HDFS-9040-HDFS-7285.005.patch
          120 kB
          Jing Zhao
        4. HDFS-9040-HDFS-7285.005.patch
          123 kB
          Jing Zhao
        5. HDFS-9040-HDFS-7285.004.patch
          120 kB
          Jing Zhao
        6. HDFS-9040-HDFS-7285.003.patch
          118 kB
          Jing Zhao
        7. HDFS-9040-HDFS-7285.002.patch
          115 kB
          Jing Zhao
        8. HDFS-9040.02.bgstreamer.patch
          74 kB
          Walter Su
        9. HDFS-9040.001.wip.patch
          112 kB
          Jing Zhao
        10. HDFS-9040.00.patch
          71 kB
          Walter Su

        Issue Links

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              walter.k.su Walter Su

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment