Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28691

Add Java/Scala DirectKerberizedKafkaWordCount examples

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • DStreams, Examples
    • None

    Description

      Now, DirectKafkaWordCount example is not support to visit kafka using kerberos authentication. Add Java/Scala DirectKerberizedKafkaWordCount.

       

       Example:
         $ bin/run-example --files ${path}/kafka_jaas.conf \
         --driver-java-options "-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
         --conf "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \
         streaming.DirectKerberizedKafkaWordCount broker1-host:port,broker2-host:port \
         consumer-group topic1,topic2 true
      

       

      Attachments

        Issue Links

          Activity

            People

              hongdongdong hong dongdong
              hongdongdong hong dongdong
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: