Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-17359

Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      Using flink 1.10

      I added theĀ flink-s3-fs-hadoop jar in plugins dir but I am seeing the checkpoints paths like s3://my_app/_ENTROPY_/app_name-staging/flink/checkpoints/e10f47968ae74934bd833108d2272419/chk-3071 which means the entropy injection key is not being resolved. After some debugging I found that in the EntropyInjector we check if the given fileSystem is of type SafetyNetWrapperFileSystem and if so we check if the delegate is of type EntropyInjectingFileSystem but don't check for ClassLoaderFixingFileSystem which would be the type if S3 file system dependencies are added as a plugin.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              premsantosh Prem Santosh
              Reporter:
              premsantosh Prem Santosh

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment