Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1081

Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • security
    • None
    • Reviewed

    Description

      We've seen a significant decrease in the performance of DistributedFileSystem::getFileBlockLocations() with security turned on Y20. This JIRA is for correcting and tracking it both on Y20 and trunk.

      Attachments

        1. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-1.patch
          14 kB
          Jakob Homan
        2. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-2.patch
          14 kB
          Jakob Homan
        3. bm1081.scala
          3 kB
          Jakob Homan
        4. HDFS-1081-trunk.patch
          15 kB
          Jakob Homan
        5. HDFS-1081-trunk.patch
          15 kB
          Jakob Homan
        6. results.xlsx
          62 kB
          Jakob Homan

        Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-1353 Remove most of getBlockLocation optimization

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jghoman Jakob Homan
            jghoman Jakob Homan
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment