Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5443

Delete 0-sized block when deleting an under-construction file that is included in snapshot

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0, 3.0.0-alpha1
    • 2.3.0
    • snapshots
    • None
    • Reviewed

    Description

      Namenode can stuck in safemode on restart if it crashes just after addblock logsync and after taking snapshot for such file. This issue is reported by Prakash and Sathish.

      On looking into the issue following things are happening.
      .
      1) Client added block at NN and just did logsync
      So, NN has block ID persisted.
      2)Before returning addblock response to client take a snapshot for root or parent directories for that file
      3) Delete parent directory for that file
      4) Now crash the NN with out responding success to client for that addBlock call

      Now on restart of the Namenode, it will stuck in safemode.

      Attachments

        1. HDFS-5443.000.patch
          8 kB
          Jing Zhao
        2. 5443-test.patch
          4 kB
          Jing Zhao

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jingzhao Jing Zhao
            umamaheswararao Uma Maheswara Rao G
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment