Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2603

Flink hangs before starting execution

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 0.9.1, 0.10.0
    • None
    • Runtime / Coordination
    • None

    Description

      The following simple application created from Flink's Java quickstart will hang before execution if the data size is to large. I have tested this on both 0.9.1 and master (7364ce18) and the threshold occurs with
      $ ./bin/flink run /path/to/blocks/target/blocks-1.0-SNAPSHOT.jar 19
      running in a few seconds while
      $ ./bin/flink run /path/to/blocks/target/blocks-1.0-SNAPSHOT.jar 20
      seemingly hangs forever.

      I first put this together two months ago so if it is a bug it is not a new bug.

      package blocks;
      
      import java.util.ArrayList;
      import java.util.List;
      
      import org.apache.flink.api.java.ExecutionEnvironment;
      import org.apache.flink.api.java.io.DiscardingOutputFormat;
      
      public class Job {
      
          public static void main(String[] args) throws Exception {
              // set up the execution environment
              final ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      
              List<Long> data = new ArrayList<>();
      
              int count = 1 << Integer.valueOf(args[0]);
              
              for (int i = 0 ; i < count ; i++) {
                  data.add(0L);
              }
      
              env.fromCollection(data).output(new DiscardingOutputFormat());
      
              System.out.println("Ready to execute ...");
              
              // execute program
              env.execute("Flink Java API Skeleton");
          }
      }
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            greghogan Greg Hogan
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: