Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23539

Add support for Kafka headers in Structured Streaming

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 3.0.0
    • Structured Streaming
    • None

    Description

      Kafka headers were added in 0.11. We should expose them through our kafka data source in both batch and streaming queries. 

      This is currently blocked on version of Kafka in Spark from 0.10.1 to 1.0+ SPARK-18057

      Attachments

        Issue Links

          Activity

            People

              dongjin Dongjin Lee
              tdas Tathagata Das
              Votes:
              4 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: