Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9289

Make DataStreamer#block thread safe and verify genStamp in commitBlock

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      we have seen a case of corrupt block which is caused by file complete after a pipelineUpdate, but the file complete with the old block genStamp. This caused the replicas of two datanodes in updated pipeline to be viewed as corrupte. Propose to check genstamp when commit block

        Attachments

        1. HDFS-9289-branch-2.6.patch
          12 kB
          Zhe Zhang
        2. HDFS-9289.branch-2.7.patch
          12 kB
          Chang Li
        3. HDFS-9289.branch-2.patch
          11 kB
          Chang Li
        4. HDFS-9289.7.patch
          12 kB
          Chang Li
        5. HDFS-9289.6.patch
          10 kB
          Chang Li
        6. HDFS-9289.5.patch
          12 kB
          Chang Li
        7. HDFS-9289.4.patch
          2 kB
          Chang Li
        8. HDFS-9289.3.patch
          11 kB
          Chang Li
        9. HDFS-9289.2.patch
          10 kB
          Chang Li
        10. HDFS-9289.1.patch
          3 kB
          Chang Li

          Issue Links

            Activity

              People

              • Assignee:
                lichangleo Chang Li
                Reporter:
                lichangleo Chang Li
              • Votes:
                0 Vote for this issue
                Watchers:
                17 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: