Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5443

Delete 0-sized block when deleting an under-construction file that is included in snapshot

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0, 3.0.0-alpha1
    • Fix Version/s: 2.3.0
    • Component/s: snapshots
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Namenode can stuck in safemode on restart if it crashes just after addblock logsync and after taking snapshot for such file. This issue is reported by Prakash and Sathish.

      On looking into the issue following things are happening.
      .
      1) Client added block at NN and just did logsync
      So, NN has block ID persisted.
      2)Before returning addblock response to client take a snapshot for root or parent directories for that file
      3) Delete parent directory for that file
      4) Now crash the NN with out responding success to client for that addBlock call

      Now on restart of the Namenode, it will stuck in safemode.

        Attachments

        1. 5443-test.patch
          4 kB
          Jing Zhao
        2. HDFS-5443.000.patch
          8 kB
          Jing Zhao

          Issue Links

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                umamaheswararao Uma Maheswara Rao G
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: