Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15627

Audit log deletes before collecting blocks

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Deletes currently collect blocks in the write lock, write the edit, incrementally block delete, finally audit log. It should be collect blocks, edit log, audit log, incremental delete. Once the edit is durable it's consistent to audit log the delete. There is no sense in deferring the audit into the indeterminate future.

      The problem occurs when thereto server hung due to large deletes but it won't be easy to identify the problem. That should have been easily identified as the first delete logged after the hang.

      Attachments

        1. HDFS-15627.001.patch
          0.8 kB
          Ahmed Hussein

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ahussein Ahmed Hussein
            ahussein Ahmed Hussein
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment