Description
Currently there are a few sub-projects, each for integrating with different external sources for Streaming. Now that we have better ability to include external libraries (Spark packages) and with Spark 2.0 coming up, we can move the following projects out of Spark to https://github.com/spark-packages
- streaming-flume
- streaming-akka
- streaming-mqtt
- streaming-zeromq
- streaming-twitter
They are just some ancillary packages and considering the overhead of maintenance, running tests and PR failures, it's better to maintain them out of Spark. In addition, these projects can have their different release cycles and we can release them faster.
Attachments
Issue Links
- is related to
-
SPARK-13877 Consider removing Kafka modules from Spark / Spark Streaming
-
- Closed
-
- relates to
-
SPARK-3449 Akka-based receiver can't find messages defined in uploaded jar
-
- Closed
-
- links to
