Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9569 Spark streaming 1.5.0 testing umbrella
  3. SPARK-9786

Test backpressure

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • None
    • DStreams
    • None

    Description

      1. Build a test bench for generating different workloads and data with varying rates - DONE
      2. Enable backpressure and test whether things it works with different workloads - DONE
      3. Test whether it works with multiple receivers - BUMPED TO FUTURE TESTING
      4. Test whether it works with Kinesis - BUMPED TO FUTURE TESTING
      5. Test whether it works with Direct Kafka - DONE by cody@koeninger.org

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue SPARK-9966 Handle a couple of corner cases in the PID rate estimator

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Sub-task - The sub-task of the issue SPARK-9968 BlockGenerator lock structure can cause lock starvation of the block updating thread

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-10072 BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #8413 [Github] Pull Request #8413 (koeninger)

          Activity

            People

              tdas Tathagata Das
              tdas Tathagata Das
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: