Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15965

Upgrade to ADLS SDK which has major performance improvement for ingress/egress

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • fs/adl
    • None

    Description

      Upgrade ADLS SDK to version 2.3.2 which has major improvements

      1. Add special handling for 404 errors when requesting tokens from MSI
      2. Fix liststatus response parsing when filestatus object contains array in one field.
      3. Use wildfly openssl native binding with Java. This is a workaround to https://bugs.openjdk.java.net/browse/JDK-8046943issue. 2X performance boost over HTTPS. Similar to HADOOP-15669

      Attachments

        1. HADOOP-15965-002.patch
          0.6 kB
          Vishwajeet Dusane
        2. HADOOP-15965-001.patch
          0.6 kB
          Vishwajeet Dusane

        Issue Links

          Activity

            People

              vishwajeet.dusane Vishwajeet Dusane
              vishwajeet.dusane Vishwajeet Dusane
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: