Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3849

Add FilterableTableSource interface and translation rule

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Implemented
    • None
    • 1.3.0
    • Table SQL / API
    • None

    Description

      Add a FilterableTableSource interface for TableSource implementations which support filter push-down.

      The interface could look as follows

      def trait FilterableTableSource {
  // returns unsupported predicate expression
  def setPredicate(predicate: Expression): Expression
}

      In addition we need Calcite rules to push a predicate (or parts of it) into a TableScan that refers to a FilterableTableSource. We might need to tweak the cost model as well to push the optimizer in the right direction.

      Attachments

        Issue Links

          is required by

          New Feature - A new feature of the product, which has yet to be developed. FLINK-2168 Add HBaseTableSource

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-2169 Add ParquetTableSource

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-2170 Add OrcTableSource

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Web Link GitHub Pull Request #3166

          Web Link GitHub Pull Request #3520

          Activity

            People

              ykt836 Kurt Young
              fhueske Fabian Hueske
              Votes:
              5 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: