Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12177

Update KafkaDStreams to new Kafka 0.10 Consumer API

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 2.0.0
    • Component/s: DStreams
    • Labels:

      Description

      Kafka 0.9 already released and it introduce new consumer API that not compatible with old one. So, I added new consumer api. I made separate classes in package org.apache.spark.streaming.kafka.v09 with changed API. I didn't remove old classes for more backward compatibility. User will not need to change his old spark applications when he uprgade to new Spark version.
      Please rewiew my changes

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                cody@koeninger.org Cody Koeninger
                Reporter:
                ntarasenko Nikita Tarasenko
              • Votes:
                21 Vote for this issue
                Watchers:
                47 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: