Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13972

ADLS to support per-store configuration

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: 3.1.0, 2.10.0, 2.9.1, 2.8.4, 3.0.3
    • Component/s: fs/adl
    • Labels:
      None
    • Target Version/s:

      Description

      Useful when distcp needs to access 2 Data Lake stores with different SPIs.

      Of course, a workaround is to grant the same SPI access permission to both stores, but sometimes it might not be feasible.

      One idea is to embed the store name in the configuration property names, e.g., dfs.adls.oauth2.<store>.client.id. Per-store keys will be consulted first, then fall back to the global keys.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ssonker Sharad Sonker
                Reporter:
                jzhuge John Zhuge
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: