Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15777

Truncate not working with plugins (as expected)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.9.1, 1.10.0, 1.11.0
    • Fix Version/s: None
    • Component/s: FileSystems

      Description

      FLINK-14170 introduced Hadoop version check to support older versions with limited functionality. However, the fix checks the Hadoop version of the system classloader and not of the plugin (of the actual used filesystem).

      The version checks will fail when there is a Hadoop version in the classpath of Flink, independent of the bundled version of the filesystem.

      On a recent EMR setup with lingering Hadoop 2.6 libraries, this mean that you cannot write to S3 with StreamingFileSink.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                arvid heise Arvid Heise
                Reporter:
                arvid heise Arvid Heise
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m