Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12422

Replace DataNode in Pipeline when waiting for Last Packet fails

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs, hdfs-client
    • Labels:
    • Hadoop Flags:
      Incompatible change

      Description

      1. Create a file with replicationFactor = 4, minReplicas = 2
      2. Fail waiting for the last packet, followed by 2 exceptions when recovering the leftover pipeline
      3. The leftover pipeline will only have one DN and NN will never close such block, resulting in failure to write

      The block will stay there forever, unable to be replicated, ultimately going missing.

        Attachments

        1. HDFS-12422.002.patch
          6 kB
          Lukas Majercak
        2. HDFS-12422.001.patch
          6 kB
          Lukas Majercak

          Issue Links

            Activity

              People

              • Assignee:
                lukmajercak Lukas Majercak
                Reporter:
                lukmajercak Lukas Majercak
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: