Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12422

Replace DataNode in Pipeline when waiting for Last Packet fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs, hdfs-client
    • Incompatible change

    Description

      1. Create a file with replicationFactor = 4, minReplicas = 2
      2. Fail waiting for the last packet, followed by 2 exceptions when recovering the leftover pipeline
      3. The leftover pipeline will only have one DN and NN will never close such block, resulting in failure to write

      The block will stay there forever, unable to be replicated, ultimately going missing.

      Attachments

        1. HDFS-12422.002.patch
          6 kB
          Lukas Majercak
        2. HDFS-12422.001.patch
          6 kB
          Lukas Majercak

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-12886 Ignore minReplication for block recovery

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lukmajercak Lukas Majercak
              lukmajercak Lukas Majercak
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: