Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11641

Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha
    • 2.9.0, 3.0.0-alpha4, 2.8.2
    • hdfs
    • None
    • Reviewed

    Description

      Audit logging operations create a HdfsFileStatus but audit logging promptly converts it to a FileStatus to pass to the loggers. A HdfsFileStatus is more expensive to create, ex. multiple node to root scans for feature info that will only be discarded in the conversion to FileStatus. Operations should create a FileStatus to eliminate all the superfluous overhead.

      Attachments

        1. HDFS-11641.patch
          34 kB
          Daryn Sharp
        2. HDFS-11641.branch-2.patch
          30 kB
          Daryn Sharp
        3. HDFS-11641.1.patch
          34 kB
          Daryn Sharp

        Issue Links

          Activity

            People

              daryn Daryn Sharp
              daryn Daryn Sharp
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: