Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15422

Reported IBR is partially replaced with stored info when queuing.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.3.1, 3.4.0
    • 3.3.1, 3.4.0, 2.10.2, 3.2.3
    • namenode
    • None
    • Reviewed

    Description

      When queueing an IBR (incremental block report) on a standby namenode, some of the reported information is being replaced with the existing stored information. This can lead to false block corruption.

      We had a namenode, after transitioning to active, started reporting missing blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were appended and the sizes were actually correct on the datanodes. Upon further investigation, it was determined that the namenode was queueing IBRs with altered information.

      Although it sounds bad, I am not making it blocker

      Attachments

        1. HDFS-15422.001.patch
          2 kB
          Stephen O'Donnell
        2. HDFS-15422-branch-2.10.001.patch
          1 kB
          Masatake Iwasaki
        3. HDFS-15422-branch-2.10.002.patch
          1 kB
          Stephen O'Donnell

        Issue Links

          Activity

            People

              sodonnell Stephen O'Donnell
              kihwal Kihwal Lee
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: