Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15627

Audit log deletes before collecting blocks

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Deletes currently collect blocks in the write lock, write the edit, incrementally block delete, finally audit log. It should be collect blocks, edit log, audit log, incremental delete. Once the edit is durable it's consistent to audit log the delete. There is no sense in deferring the audit into the indeterminate future.

      The problem occurs when thereto server hung due to large deletes but it won't be easy to identify the problem. That should have been easily identified as the first delete logged after the hang.

      Attachments

        1. HDFS-15627.001.patch
          0.8 kB
          Ahmed Hussein

        Activity

          People

            ahussein Ahmed Hussein
            ahussein Ahmed Hussein
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: