Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-17359

Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin

    XMLWordPrintableJSON

    Details

      Description

      Using flink 1.10

      I added theĀ flink-s3-fs-hadoop jar in plugins dir but I am seeing the checkpoints paths like s3://my_app/_ENTROPY_/app_name-staging/flink/checkpoints/e10f47968ae74934bd833108d2272419/chk-3071 which means the entropy injection key is not being resolved. After some debugging I found that in the EntropyInjector we check if the given fileSystem is of type SafetyNetWrapperFileSystem and if so we check if the delegate is of type EntropyInjectingFileSystem but don't check for ClassLoaderFixingFileSystem which would be the type if S3 file system dependencies are added as a plugin.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                premsantosh Prem Santosh
                Reporter:
                premsantosh Prem Santosh
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: