Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14249 Complete partition support for batch sql
  3. FLINK-14265

Don't use ContinuousFileReaderOperator to support multiple paths

    XMLWordPrintableJSON

Details

    Description

      Now, blink planner use ContinuousFileReaderOperator to support InputFormat, but ContinuousFileReaderOperator not support multiple paths.

      If read partitioned source, after partition pruning, we need let InputFormat to read multiple partitions which are multiple paths.

      We can use InputFormatSourceFunction directly to support InputFormat.

      Attachments

        Issue Links

          Activity

            People

              lzljs3620320 Jingsong Lee
              lzljs3620320 Jingsong Lee
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m