Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15422

Reported IBR is partially replaced with stored info when queuing.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.1, 3.4.0, 2.10.2, 3.2.3
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:

      Description

      When queueing an IBR (incremental block report) on a standby namenode, some of the reported information is being replaced with the existing stored information. This can lead to false block corruption.

      We had a namenode, after transitioning to active, started reporting missing blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were appended and the sizes were actually correct on the datanodes. Upon further investigation, it was determined that the namenode was queueing IBRs with altered information.

      Although it sounds bad, I am not making it blocker

        Attachments

        1. HDFS-15422-branch-2.10.002.patch
          1 kB
          Stephen O'Donnell
        2. HDFS-15422-branch-2.10.001.patch
          1 kB
          Masatake Iwasaki
        3. HDFS-15422.001.patch
          2 kB
          Stephen O'Donnell

          Activity

            People

            • Assignee:
              sodonnell Stephen O'Donnell
              Reporter:
              kihwal Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: