Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1908

Restructure data node code so that block sending/receiving is seperated from data transfer header handling

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.14.1
    • 0.15.0
    • None
    • None

    Description

      This jira is intended for code sharing. I'd like to have a BlockSender which is resposible for reading a block from a disk and writing it to an output stream, and a BlockReceiver which receives a block from an input stream, writes it to a disk, and possibly writes it a mirror ouput stream to support pipeline writes. Block sender and receiver code is independent of any block IO protocols so it could be shared by block transfer, block write, block read, and future block replacement introduced by data node rebalancing.

      Attachments

        1. datanode.patch
          37 kB
          Hairong Kuang
        2. datanodeRestructure.patch
          38 kB
          Hairong Kuang
        3. datanodeRestructure.patch
          37 kB
          Hairong Kuang
        4. datanodeRestructure1.patch
          39 kB
          Hairong Kuang
        5. datanodeRestructure2.patch
          41 kB
          Hairong Kuang
        6. datanodeRestructure3.patch
          40 kB
          Hairong Kuang

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-1912 Datanode should support block replacement

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: