Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15965

Upgrade to ADLS SDK which has major performance improvement for ingress/egress

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: fs/adl
    • Labels:
      None

      Description

      Upgrade ADLS SDK to version 2.3.2 which has major improvements

      1. Add special handling for 404 errors when requesting tokens from MSI
      2. Fix liststatus response parsing when filestatus object contains array in one field.
      3. Use wildfly openssl native binding with Java. This is a workaround to https://bugs.openjdk.java.net/browse/JDK-8046943issue. 2X performance boost over HTTPS. Similar to HADOOP-15669

        Attachments

        1. HADOOP-15965-001.patch
          0.6 kB
          Vishwajeet Dusane
        2. HADOOP-15965-002.patch
          0.6 kB
          Vishwajeet Dusane

          Issue Links

            Activity

              People

              • Assignee:
                vishwajeet.dusane Vishwajeet Dusane
                Reporter:
                vishwajeet.dusane Vishwajeet Dusane
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: