Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13473

DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • datanode
    • None

    Description

      +underlined text+It is passive behavior about updating Block keys for DataNode currently, and it depends on if NameNode return #KeyUpdateCommand for heartbeat response.
      There are several problems of this Block keys synchronization mode:
      a. NameNode can't be sensed about if Block Keys reach DataNode successfully,
      b. It is also not sensed for DataNode who meets some exception while receive or process heartbeat response which include BlockKeyCommand,
      such as HDFS-13441 and HDFS-12749 mentioned.
      So I propose improve Push Block Keys from NameNode for DataNode to DataNode Pull Block Keys.

      Attachments

        1. HDFS-13473-trunk.001.patch
          13 kB
          Xiaoqiao He
        2. HDFS-13473-trunk.002.patch
          37 kB
          Xiaoqiao He
        3. HDFS-13473-trunk.003.patch
          40 kB
          Xiaoqiao He
        4. HDFS-13473-trunk.004.patch
          41 kB
          Xiaoqiao He
        5. HDFS-13473-trunk.005.patch
          40 kB
          Xiaoqiao He
        6. HDFS-13473-trunk.006.patch
          37 kB
          Xiaoqiao He
        7. HDFS-13473-trunk.007.patch
          37 kB
          Xiaoqiao He

        Activity

          People

            hexiaoqiao Xiaoqiao He
            hexiaoqiao Xiaoqiao He
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: