Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20600

KafkaRelation should be pretty printed in web UI (Details for Query)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • Structured Streaming
    • None

    Description

      Executing the following batch query gives the default stringified internal JVM representation of KafkaRelation in web UI (under Details for Query), i.e. http://localhost:4040/SQL/execution/?id=3 (<-- change the id). See the attachment.

      spark.
        read.
        format("kafka").
        option("subscribe", "topic1").
        option("kafka.bootstrap.servers", "localhost:9092").
        load.
        show
      

      Attachments

        1. kafka-source-scan-webui.png
          198 kB
          Jacek Laskowski

        Activity

          People

            jlaskowski Jacek Laskowski
            jlaskowski Jacek Laskowski
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: