Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16288

Using an authenticated proxy server to access ADLS and ABFS storage

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.2.0
    • Fix Version/s: None
    • Component/s: fs/adl, fs/azure
    • Labels:
      None

      Description

      Given an environment which does not have direct access to the internet, but has to route all requests through a Proxy that requires authentication Hadoop filesystem commands can not go through.

      My understanding of an Official Java blog, is that  this requires a special Authenticator class to be used, which I do not see anywhere in the code, neither I could find any relevant parameter to set the proxy authentication credentials.

      I tried to specify the proxy in a form of username:password@host.fqdn and the port via java system properties, but that did not work either.

      My use case is to connect to ADLS, but I have not seen relevant properties either for S3.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              pifta Istvan Fajth
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: