Description
Spark streaming can be tricky with dynamic allocation and can lose data if not used properly (with WAL, or with WAL-free solutions like Direct Kafka and Kinesis since 1.5). If dynamic allocation is enabled, we should issue a log4j warning.
Attachments
Issue Links
- is related to
-
SPARK-12133 Support dynamic allocation in Spark Streaming
-
- Resolved
-
- links to