Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-16015

Refine fallback filesystems to only handle specific filesystems

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      By default, if there is an official filesystem plugin for a given schema, it will not be allowed to use fallback filesystem factories (like HADOOP libraries on the classpath) to load it. Added {{fs.allowed-fallback-filesystems}} configuration option to override this behaviour.
      Show
      By default, if there is an official filesystem plugin for a given schema, it will not be allowed to use fallback filesystem factories (like HADOOP libraries on the classpath) to load it. Added {{fs.allowed-fallback-filesystems}} configuration option to override this behaviour.

      Description

      Currently, if no s3 plugin is included, hadoop is used as a fallback, which introduces a wide variety of problems. We should probably only white list specific protocols that work well (e.g. hdfs).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                arvid heise Arvid Heise
                Reporter:
                arvid heise Arvid Heise
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m