Details

    Description

      StatementSet solves use cases for pure SQL & Table API pipelines. However, currently there is no way of creating StatementSet for a DataStream API job.

      We propose the following API:

      StreamTableEnvironment.createStatementSet(): StreamStatementSet // return a stream-specific set
      
      StreamStatementSet extends StatementSet {
        /**
         * Attaches the optimized statement set to the DataStream pipeline.
         */
        attachAsDataStream(): Unit
      }
      

      An example could look like:

      StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
      StreamTableEnvironment tEnv = StreamTableEnvironment.create(env);
      
      tEnv
        .createStatementSet()
        .addInsert(tEnv.from("FromTable"))
        .attachAsDataStream();
      
      tEnv.from("OtherTable").toDataStream(...) // continue with further operations
      

      Attachments

        Issue Links

          Activity

            People

              twalthr Timo Walther
              twalthr Timo Walther
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: