Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1081

Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We've seen a significant decrease in the performance of DistributedFileSystem::getFileBlockLocations() with security turned on Y20. This JIRA is for correcting and tracking it both on Y20 and trunk.

      1. HDFS-1081-trunk.patch
        15 kB
        Jakob Homan
      2. results.xlsx
        62 kB
        Jakob Homan
      3. bm1081.scala
        3 kB
        Jakob Homan
      4. HDFS-1081-trunk.patch
        15 kB
        Jakob Homan
      5. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-2.patch
        14 kB
        Jakob Homan
      6. ASF.LICENSE.NOT.GRANTED--HADOOP-1081-Y20-1.patch
        14 kB
        Jakob Homan

        Issue Links

          Activity

          Jakob Homan created issue -
          Jakob Homan made changes -
          Field Original Value New Value
          Attachment HADOOP-1081-Y20-1.patch [ 12442009 ]
          Jakob Homan made changes -
          Attachment HADOOP-1081-Y20-2.patch [ 12442023 ]
          Jakob Homan made changes -
          Attachment HDFS-1081-trunk.patch [ 12449886 ]
          Jakob Homan made changes -
          Attachment bm1081.scala [ 12449887 ]
          Jakob Homan made changes -
          Attachment results.xlsx [ 12449888 ]
          Jakob Homan made changes -
          Attachment HDFS-1081-trunk.patch [ 12449889 ]
          Jakob Homan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 0.22.0 [ 12314241 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Jakob Homan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jakob Homan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jakob Homan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-1353 [ HDFS-1353 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Jakob Homan
              Reporter:
              Jakob Homan
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development