Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-16517

Add a long running WordCount example

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Won't Fix
    • None
    • None
    • Examples

    Description

      As far as I know, flink doesn't have a long running WordCount example for users to start with or doing some simple tests.  

      The closest one is SocketWindowWordCount. But it requires setting up a server (nc -l ), which is not hard, but still tedious for simple use cases. And it requires human input for the job to actually run.

      I propose to add or modify current WordCount example to have a SourceFunction that randomly generates input data based on a set of sentences, so the WordCount job can run forever. The generation ratio will be configurable.

      This will be the easiest way to start a long running flink job and can be useful for new users to start using flink quickly, or for developers to test flink easily.

      Attachments

        Issue Links

          Activity

            People

              ethanli Ethan Li
              ethanli Ethan Li
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m