Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12422

Replace DataNode in Pipeline when waiting for Last Packet fails

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs, hdfs-client
    • Labels:
    • Hadoop Flags:
      Incompatible change

      Description

      1. Create a file with replicationFactor = 4, minReplicas = 2
      2. Fail waiting for the last packet, followed by 2 exceptions when recovering the leftover pipeline
      3. The leftover pipeline will only have one DN and NN will never close such block, resulting in failure to write

      The block will stay there forever, unable to be replicated, ultimately going missing.

        Attachments

        1. HDFS-12422.001.patch
          6 kB
          Lukas Majercak
        2. HDFS-12422.002.patch
          6 kB
          Lukas Majercak

        Issue Links

          Activity

            People

            • Assignee:
              lukmajercak Lukas Majercak
              Reporter:
              lukmajercak Lukas Majercak

              Dates

              • Created:
                Updated:

                Issue deployment