Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13972

ADLS to support per-store configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha2
    • 3.1.0, 2.10.0, 2.9.1, 2.8.4, 3.0.3
    • fs/adl
    • None

    Description

      Useful when distcp needs to access 2 Data Lake stores with different SPIs.

      Of course, a workaround is to grant the same SPI access permission to both stores, but sometimes it might not be feasible.

      One idea is to embed the store name in the configuration property names, e.g., dfs.adls.oauth2.<store>.client.id. Per-store keys will be consulted first, then fall back to the global keys.

      Attachments

        Issue Links

          Activity

            People

              ssonker Sharad Sonker
              jzhuge John Zhuge
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: