Kafka 0.9 already released and it introduce new consumer API that not compatible with old one. So, I added new consumer api. I made separate classes in package org.apache.spark.streaming.kafka.v09 with changed API. I didn't remove old classes for more backward compatibility. User will not need to change his old spark applications when he uprgade to new Spark version.
Please rewiew my changes
- is blocked by
-
SPARK-13252 Bump up Kafka to 0.9.0.0
-
- Resolved
-
- is duplicated by
-
SPARK-15089 kafka-spark consumer with SSL problem
-
- Resolved
-
- relates to
-
-
- Resolved
-
- links to
(2 links to)
1.
|
Rename current streaming-kafka artifact to include kafka version |
|
Resolved | Cody Koeninger |
2.
|
code cleanup of kafka-0-8 to match review feedback on 0-10 |
|
Resolved | Cody Koeninger |
3.
|
Docs for Kafka 0.10 consumer integration |
|
Resolved | Cody Koeninger |
4.
|
unidoc workaround for multiple kafka versions |
|
Resolved | Cody Koeninger |
5.
|
Kafka 0.10 Python support |
|
In Progress | Unassigned |