Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13101

Yet another fsimage corruption related to snapshot

    XMLWordPrintableJSON

Details

    • Hide
      Fix a corner case in deleting HDFS snapshots. A regression was later found and fixed by HDFS-15012.
      Show
      Fix a corner case in deleting HDFS snapshots. A regression was later found and fixed by HDFS-15012 .

    Description

      Lately we saw case similar to HDFS-9406, even though HDFS-9406 fix is present, so it's likely another case not covered by the fix. We are currently trying to collect good fsimage + editlogs to replay to reproduce it and investigate.

      Attachments

        1. HDFS-13101.branch-2.8.patch
          13 kB
          Wei-Chiu Chuang
        2. HDFS-13101.branch-2.001.patch
          13 kB
          Wei-Chiu Chuang
        3. HDFS-13101.004.patch
          13 kB
          Shashikant Banerjee
        4. HDFS-13101.003.patch
          13 kB
          Shashikant Banerjee
        5. HDFS-13101.002.patch
          5 kB
          Siyao Meng
        6. HDFS-13101.corruption_repro_simplified.patch
          2 kB
          Wei-Chiu Chuang
        7. HDFS-13101.corruption_repro.patch
          2 kB
          Shashikant Banerjee
        8. HDFS-13101.001.patch
          4 kB
          Adam Antal

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15276 Concat on INodeRefernce fails with illegal state exception

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15313 Ensure inodes in active filesystem are not deleted during snapshot delete

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9406 FSImage may get corrupted after deleting snapshot

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15012 NN fails to parse Edit logs after applying HDFS-13101

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13314 NameNode should optionally exit if it detects FsImage corruption

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              shashikant Shashikant Banerjee
              yzhangal Yongjun Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: