Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1081

Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • security
    • None
    • Reviewed

    Description

      We've seen a significant decrease in the performance of DistributedFileSystem::getFileBlockLocations() with security turned on Y20. This JIRA is for correcting and tracking it both on Y20 and trunk.

      Attachments

        1. results.xlsx
          62 kB
          Jakob Homan
        2. HDFS-1081-trunk.patch
          15 kB
          Jakob Homan
        3. HDFS-1081-trunk.patch
          15 kB
          Jakob Homan
        4. bm1081.scala
          3 kB
          Jakob Homan
        5. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-2.patch
          14 kB
          Jakob Homan
        6. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-1.patch
          14 kB
          Jakob Homan

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1353 Remove most of getBlockLocation optimization

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jghoman Jakob Homan
              jghoman Jakob Homan
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: