Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12177

Update KafkaDStreams to new Kafka 0.10 Consumer API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.6.0
    • 2.0.0
    • DStreams

    Description

      Kafka 0.9 already released and it introduce new consumer API that not compatible with old one. So, I added new consumer api. I made separate classes in package org.apache.spark.streaming.kafka.v09 with changed API. I didn't remove old classes for more backward compatibility. User will not need to change his old spark applications when he uprgade to new Spark version.
      Please rewiew my changes

      Attachments

        Issue Links

          Activity

            People

              koeninger Cody Koeninger
              ntarasenko Nikita Tarasenko
              Votes:
              21 Vote for this issue
              Watchers:
              47 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: