Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17534

Increase timeouts for DirectKafkaStreamSuite tests

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.1.0
    • 2.1.0
    • Tests
    • None

    Description

      The current tests in DirectKafkaStreamSuite rely on a certain number of messages being received within a given timeframe

      On machines with four+ cores and better clock speeds, this doesn't pose a problem, but on a two core x86 box I regularly see timeouts within two tests within this suite.

      To avoid other users hitting the same problem and needlessly doing their own investigations, let's increase the timeouts. By using 1 sec instead of 0.2 sec batch durations and increasing the timeout to be 100 seconds not 20, we consistently see the tests passing even on less powerful hardware

      I see the problem consistently using a machine with 2x
      Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz and 16 GB of RAM, 1 TB HDD

      Pull request to follow

      Attachments

        Activity

          People

            aroberts Adam Roberts
            aroberts Adam Roberts
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: