Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2419

Misc updates to streaming programming guide

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • None
    • DStreams
    • None

    Description

      This JIRA collects together a number of small issues that should be added to the streaming programming guide

      • Receivers consume an executor slot and highlight the fact the # cores > # receivers is necessary
      • Classes of spark-streaming-XYZ cannot be access from Spark Shell
      • Deploying and using spark-streaming-XYZ requires spark-streaming-XYZ.jar and its dependencies to be packaged with application JAR
      • Ordering and parallelism of the output operations
      • Receiver's should be serializable
      • Add more information on how socketStream: input stream => iterator function.
      • New Flume and Kinesis stuff.
      • Twitter4j version
      • Design pattern: creating connections to external sinks
      • Design pattern: multiple input streams

      Attachments

        Activity

          People

            tdas Tathagata Das
            tdas Tathagata Das
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: