Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22132

Test unaligned checkpoints rescaling manually on a real cluster

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      To test unaligned checkpoints, we should use a few different applications that use different features.

      The sinks should not be mocked but rather should be able to induce a fair amount of backpressure into the system. Quite possibly, it would be a good idea to have a way to add more backpressure to the sink by running the respective system on the cluster and be able to add/remove parallel instances.

      The primary objective is to check if all data is recovered properly and if the semantics is correct (does state match input?).

      The secondary objective is to check if Flink UI shows the information correctly.

      More details in the subtasks.

        Attachments

          Activity

            People

            • Assignee:
              akalashnikov Anton Kalashnikov
              Reporter:
              pnowojski Piotr Nowojski

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment