[FLINK-3133] Introduce collect()/count()/print() methods in DataStream API

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 0.10.0, 0.10.1, 1.0.0
• Component/s: API / DataStream
• Labels: auto-deprioritized-major auto-unassigned
• Assignee: Unassigned
• Reporter: Maximilian Michels
• Created: 07/Dec/15 15:46
• Updated: 28/Jun/21 11:52
• Resolved: 28/Jun/21 11:52

Description

The DataSet API's methods collect(), count(), and print() should be mirrored to the DataStream API.

The semantics of the calls are different. We need to be able to sample parts of a stream, e.g. by supplying a time period in the arguments to the methods. Users should use the JobClient to retrieve the results.

StreamExecutionEnvironment env = StramEnvironment.getStreamExecutionEnvironment();

DataStream<DataType> streamData = env.addSource(..).map(..);

JobClient jobClient = env.executeWithControl();

Iterable<DataType> sampled = jobClient.sampleStream(streamData, Time.seconds(5));

Issue Links

• is related to: FLINK-4272 Create a JobClient for job control and monitoring
• is related to: FLINK-2313 Change Streaming Driver Execution Model