Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21030

Broken job restart for job with disjoint graph

    XMLWordPrintableJSON

    Details

      Description

      Building on top of bugs:

      https://issues.apache.org/jira/browse/FLINK-21028

       and https://issues.apache.org/jira/browse/FLINK-21029 :

      I tried to stop a Flink application on YARN via savepoint which didn't succeed due to a possible bug/racecondition in shutdown (Bug 21028). Due to some reason, Flink attempted to restart the pipeline after the failure in shutdown (21029). The bug here:

      As I mentioned: My jobgraph is disjoint and the pipelines are fully isolated. Lets say the original error occured in a single task of pipeline1. Flink then restarted the entire pipeline1, but pipeline2 was shutdown successfully and switched the state to FINISHED.

      My job thus was in kind of an invalid state after the attempt to stopping: One of two pipelines was running, the other was FINISHED. I guess this is kind of a bug in the restarting behavior that only all connected components of a graph are restarted, but the others aren't...

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mapohl Matthias
                Reporter:
                TheoD Theo Diefenthal
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: