Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15422

Reported IBR is partially replaced with stored info when queuing.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 3.3.1, 3.4.0, 2.10.2, 3.2.3
    • namenode
    • None

    Description

      When queueing an IBR (incremental block report) on a standby namenode, some of the reported information is being replaced with the existing stored information. This can lead to false block corruption.

      We had a namenode, after transitioning to active, started reporting missing blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were appended and the sizes were actually correct on the datanodes. Upon further investigation, it was determined that the namenode was queueing IBRs with altered information.

      Although it sounds bad, I am not making it blocker

      Attachments

        1. HDFS-15422.001.patch
          2 kB
          Stephen O'Donnell
        2. HDFS-15422-branch-2.10.001.patch
          1 kB
          Masatake Iwasaki
        3. HDFS-15422-branch-2.10.002.patch
          1 kB
          Stephen O'Donnell

        Activity

          People

            sodonnell Stephen O'Donnell
            kihwal Kihwal Lee
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: