Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25518

Spark kafka delegation token supported

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.3.1
    • Fix Version/s: None
    • Component/s: Structured Streaming
    • Labels:

      Description

      As we can notice, Kafka is going to support delegation tokenhttps://cwiki-test.apache.org/confluence/display/KAFKA/KIP-48+Delegation+token+support+for+Kafka. Spark need to use the delegation token for Kafka cluster as delegation token for HDFS, Hive and HBase server.

      In this Jira, we are going to track how to provide the delegation token for Spark Streaming to read and write data from/to Kafka.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                merlin Mingjie Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: