Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-23906

Increase akka.ask.timeout for tests using the MiniCluster

    XMLWordPrintableJSON

Details

    • Hide
      The default `akka.ask.timeout` used by the `MiniCluster` has been increased to 5 minutes. If you want to use a smaller value, then you have to set it explicitly in the passed configuration.

      The change is due to the fact that messages cannot get lost in a single-process minicluster, so this timeout (which otherwise helps to detect message loss in distributed setups) has no benefit here.

      The increased timeout reduces the number of false-positive timeouts, for example during heavy tests on loaded CI/CD workers or during debugging.
      Show
      The default `akka.ask.timeout` used by the `MiniCluster` has been increased to 5 minutes. If you want to use a smaller value, then you have to set it explicitly in the passed configuration. The change is due to the fact that messages cannot get lost in a single-process minicluster, so this timeout (which otherwise helps to detect message loss in distributed setups) has no benefit here. The increased timeout reduces the number of false-positive timeouts, for example during heavy tests on loaded CI/CD workers or during debugging.

    Description

      We have seen over the last couple of weeks/months an increased number of test failures because of TimeoutException that were triggered because the akka.ask.timeout was exceeded. The reason for this was that on our CI infrastructure it can happen that there are pauses of more than 10s (not sure about the exact reason) or our infrastructure simply being slow.

      In order to harden all tests relying on the MiniCluster I propose to increase the akka.ask.timeout to 5 minutes if nothing else has been configured.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23682 HAQueryableStateFsBackendITCase.testCustomKryoSerializerHandling fails due to AskTimeoutException

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23682 HAQueryableStateFsBackendITCase.testCustomKryoSerializerHandling fails due to AskTimeoutException

          • Major - Major loss of function.
          • Closed

          Technical Debt - FLINK-22333 Elasticsearch7DynamicSinkITCase.testWritingDocuments failed due to deploy task timeout.

          • Major - Major loss of function.
          • Closed

          Technical Debt - FLINK-21538 Elasticsearch6DynamicSinkITCase.testWritingDocuments fails when submitting job

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Web Link GitHub Pull Request #16921

          Activity

            People

              trohrmann Till Rohrmann
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: