Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2419

Misc updates to streaming programming guide

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DStreams
    • Labels:
      None
    • Target Version/s:

      Description

      This JIRA collects together a number of small issues that should be added to the streaming programming guide

      • Receivers consume an executor slot and highlight the fact the # cores > # receivers is necessary
      • Classes of spark-streaming-XYZ cannot be access from Spark Shell
      • Deploying and using spark-streaming-XYZ requires spark-streaming-XYZ.jar and its dependencies to be packaged with application JAR
      • Ordering and parallelism of the output operations
      • Receiver's should be serializable
      • Add more information on how socketStream: input stream => iterator function.
      • New Flume and Kinesis stuff.
      • Twitter4j version
      • Design pattern: creating connections to external sinks
      • Design pattern: multiple input streams

        Attachments

          Activity

            People

            • Assignee:
              tdas Tathagata Das
              Reporter:
              tdas Tathagata Das
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: