Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15777

Truncate not working with plugins (as expected)

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.9.1, 1.10.0, 1.11.0
    • Fix Version/s: None
    • Component/s: FileSystems

      Description

      FLINK-14170 introduced Hadoop version check to support older versions with limited functionality. However, the fix checks the Hadoop version of the system classloader and not of the plugin (of the actual used filesystem).

      The version checks will fail when there is a Hadoop version in the classpath of Flink, independent of the bundled version of the filesystem.

      On a recent EMR setup with lingering Hadoop 2.6 libraries, this mean that you cannot write to S3 with StreamingFileSink.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              arvid heise Arvid Heise
              Reporter:
              arvid heise Arvid Heise

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment