[SPARK-4184] Improve Spark Streaming documentation to address commonly-asked questions

• Type: Documentation
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: DStreams
• Labels: documentation streaming
• Target Version/s: 1.4.0
• Assignee: Unassigned
• Reporter: Chris Fregly
• Created: 01/Nov/14 17:48
• Updated: 03/May/15 22:36
• Resolved: 03/May/15 22:36

Description

Improve Streaming documentation including API descriptions, concurrency/thread safety, fault tolerance, replication, checkpointing, scalability, resource allocation and utilization, back pressure, and monitoring.

also, add a section to the kinesis streaming guide describing how to use IAM roles with the Spark Kinesis Receiver.

Issue Links

• is related to: SPARK-6599 Improve usability and reliability of Kinesis stream