Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28691

Add Java/Scala DirectKerberizedKafkaWordCount examples

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: DStreams, Examples
    • Labels:
      None

      Description

      Now, DirectKafkaWordCount example is not support to visit kafka using kerberos authentication. Add Java/Scala DirectKerberizedKafkaWordCount.

       

       Example:
         $ bin/run-example --files ${path}/kafka_jaas.conf \
         --driver-java-options "-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
         --conf "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \
         streaming.DirectKerberizedKafkaWordCount broker1-host:port,broker2-host:port \
         consumer-group topic1,topic2 true
      

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hongdongdong hong dongdong
                Reporter:
                hongdongdong hong dongdong
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: