Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14043

SavepointMigrationTestBase is super slow

    XMLWordPrintableJSON

    Details

      Description

      The subclasses of SavepointMigrationTestBase take super long to execute. On my local machine

      • TypeSerializerSnapshotMigrationITCase takes 2min 30s
      • StatefulJobWBroadcastStateMigrationITCase takes 1min 45s
      • StatefulJobSavepointMigrationITCase takes 2min 5s

      to execute. The reasons for the long runtimes seem to be that we are using the AccumulatorCountingSink which uses the accumulators to signal when a job is done. Since the accumulators are being sent with the TM heartbeats, the heartbeat interval how fast the client realizes that the job can be shut down. The default heartbeat interval is 10 s and hence it takes always at least 10 seconds until the client stops the job.

      I suggest to decrease the heartbeat interval in the SavepointMigrationTestBase to 300ms in order to speed up the tests. On my machine the test runtimes with this settings are:

      • TypeSerializerSnapshotMigrationITCase takes 13s
      • StatefulJobWBroadcastStateMigrationITCase takes 10s
      • StatefulJobSavepointMigrationITCase takes 11s

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                trohrmann Till Rohrmann
                Reporter:
                trohrmann Till Rohrmann
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m