Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25518

Spark kafka delegation token supported

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 2.3.1
    • None
    • Structured Streaming

    Description

      As we can notice, Kafka is going to support delegation tokenhttps://cwiki-test.apache.org/confluence/display/KAFKA/KIP-48+Delegation+token+support+for+Kafka. Spark need to use the delegation token for Kafka cluster as delegation token for HDFS, Hive and HBase server.

      In this Jira, we are going to track how to provide the delegation token for Spark Streaming to read and write data from/to Kafka.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              merlin Mingjie Tang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: