Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2492

KafkaReceiver minor changes to align with Kafka 0.8

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.2.0
    • Component/s: DStreams
    • Labels:
      None
    • Target Version/s:

      Description

      Update to delete Zookeeper metadata when Kafka's parameter "auto.offset.reset" is set to "smallest", which is aligned with Kafka 0.8's ConsoleConsumer.

      Also use Kafka offered API without directly using zkClient.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jerryshao Saisai Shao
                Reporter:
                jerryshao Saisai Shao
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: