Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14807

Add TableResult#collect api for fetching data to client

    XMLWordPrintableJSON

Details

    Description

      Currently, it is very unconvinient for user to fetch data of flink job unless specify sink expclitly and then fetch data from this sink via its api (e.g. write to hdfs sink, then read data from hdfs). However, most of time user just want to get the data and do whatever processing he want. So it is very necessary for flink to provide api Table#collect for this purpose. 

       

      Other apis such as Table#head, Table#print is also helpful.  

       

      Attachments

        1. table-collect-draft.patch
          127 kB
          Caizhi Weng
        2. table-collect.png
          22 kB
          Caizhi Weng

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. FLINK-17146 Support conversion between PyFlink Table and Pandas DataFrame

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-13943 Provide api to convert flink table to java List (blink planner)

          • Major - Major loss of function.
          • Closed
          is blocked by

          Sub-task - The sub-task of the issue FLINK-15102 Allow users to construct a DataStream from a new Source API

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue FLINK-16845 Implement SourceReaderOperator which runs the SourceReader.

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue FLINK-16998 Add a changeflag to Row type

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-17680 Support @ExcludeFromDocumentation in RestAPIDocGenerator

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue FLINK-17252 supports SELECT statement in TableEnvironment#executeSql and Table#execute api

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-22047 Could not find FLINSHED Flink job and can't submit job

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #12037

          Web Link GitHub Pull Request #12069

          Web Link GitHub Pull Request #12073

          Web Link GitHub Pull Request #12202

          Activity

            People

              TsReaper Caizhi Weng
              zjffdu Jeff Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: