Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14130

Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HADOOP-13345
    • fs/s3
    • None

    Description

      So, we are using deprecated AmazonDynamoDBClient class to create a DynamoDB client instead of the recommended builder. We had discussion in HADOOP-14090 for preferring region to endpoints for user to specify the DynamoDB region (if associated S3 region is unknown or different). We have reported inconsistent behavior if endpoint and S3 region are different in HADOOP-14027. We also noticed that DynamoDBMetadataStore may sometimes logs nonsense region. And in HADOOP-13252, we also have feelings that file system URI is not needed to create a AWSCredentialProvider. Resultantly we don't need to pass down file system URI for creating a DynamoDB client.

      So this JIRA is to change this, best effort.

      Attachments

        1. HADOOP-14130-HADOOP-13345.001.patch
          24 kB
          Mingliang Liu
        2. HADOOP-14130-HADOOP-13345.000.patch
          19 kB
          Mingliang Liu

        Activity

          People

            liuml07 Mingliang Liu
            liuml07 Mingliang Liu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: