Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1908

Restructure data node code so that block sending/receiving is seperated from data transfer header handling

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.14.1
    • 0.15.0
    • None
    • None

    Description

      This jira is intended for code sharing. I'd like to have a BlockSender which is resposible for reading a block from a disk and writing it to an output stream, and a BlockReceiver which receives a block from an input stream, writes it to a disk, and possibly writes it a mirror ouput stream to support pipeline writes. Block sender and receiver code is independent of any block IO protocols so it could be shared by block transfer, block write, block read, and future block replacement introduced by data node rebalancing.

      Attachments

        1. datanode.patch
          37 kB
          Hairong Kuang
        2. datanodeRestructure.patch
          38 kB
          Hairong Kuang
        3. datanodeRestructure.patch
          37 kB
          Hairong Kuang
        4. datanodeRestructure1.patch
          39 kB
          Hairong Kuang
        5. datanodeRestructure2.patch
          41 kB
          Hairong Kuang
        6. datanodeRestructure3.patch
          40 kB
          Hairong Kuang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hairong Hairong Kuang
            hairong Hairong Kuang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment