Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13972

ADLS to support per-store configuration

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: 3.1.0, 2.10.0, 2.9.1, 2.8.4, 3.0.3
    • Component/s: fs/adl
    • Labels:
      None
    • Target Version/s:

      Description

      Useful when distcp needs to access 2 Data Lake stores with different SPIs.

      Of course, a workaround is to grant the same SPI access permission to both stores, but sometimes it might not be feasible.

      One idea is to embed the store name in the configuration property names, e.g., dfs.adls.oauth2.<store>.client.id. Per-store keys will be consulted first, then fall back to the global keys.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              ssonker Sharad Sonker
              Reporter:
              jzhuge John Zhuge

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment