Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14807

Add TableResult#collect api for fetching data to client

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Currently, it is very unconvinient for user to fetch data of flink job unless specify sink expclitly and then fetch data from this sink via its api (e.g. write to hdfs sink, then read data from hdfs). However, most of time user just want to get the data and do whatever processing he want. So it is very necessary for flink to provide api Table#collect for this purpose. 

       

      Other apis such as Table#head, Table#print is also helpful.  

       

      Attachments

        Issue Links

        blocks

        New Feature - A new feature of the product, which has yet to be developed. FLINK-17146 Support conversion between PyFlink Table and Pandas DataFrame

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        duplicates

        Improvement - An improvement or enhancement to an existing feature or task. FLINK-13943 Provide api to convert flink table to java List (blink planner)

        • Major - Major loss of function.
        • Closed
        is blocked by

        Sub-task - The sub-task of the issue FLINK-15102 Allow users to construct a DataStream from a new Source API

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue FLINK-16845 Implement SourceReaderOperator which runs the SourceReader.

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue FLINK-16998 Add a changeflag to Row type

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. FLINK-17680 Support @ExcludeFromDocumentation in RestAPIDocGenerator

        • Major - Major loss of function.
        • Resolved
        relates to

        Sub-task - The sub-task of the issue FLINK-17252 supports SELECT statement in TableEnvironment#executeSql and Table#execute api

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. FLINK-22047 Could not find FLINSHED Flink job and can't submit job

        • Major - Major loss of function.
        • Closed
        links to

        Web Link GitHub Pull Request #12037

        Web Link GitHub Pull Request #12069

        Web Link GitHub Pull Request #12073

        Web Link GitHub Pull Request #12202

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            TsReaper Caizhi Weng
            zjffdu Jeff Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment