Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-18676

Update version of aws to support use of default constructor of "WebIdentityTokenCredentialsProvider"

    XMLWordPrintableJSON

    Details

      Description

      Background:

      I am using Flink 1.11.0 on kubernetes platform. To give access of aws services to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I have configured below property in flink-conf.yaml to use credential provider.

      fs.s3a.aws.credentials.provider: com.amazonaws.auth.WebIdentityTokenCredentialsProvider

       

      Issue:

      When taskmanager/jobmanager is starting up, during this it complains that "WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and container doesn't come up.

       

      Solution:

      Currently the above credential's class is being used from "flink-s3-fs-hadoop" which gets "aws-java-sdk-core" dependency from "flink-s3-fs-base". In "flink-s3-fs-base",  version of aws is 1.11.754 . The support of default constructor for "WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and onward.

        Attachments

          Activity

            People

            • Assignee:
              rmetzger Robert Metzger
              Reporter:
              raviratnakar Ravi Bhushan Ratnakar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: