Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27045

SQL tab in UI shows actual SQL instead of callsite in case of SparkSQLDriver

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.2, 2.3.3, 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: SQL, Web UI
    • Labels:
      None

      Description

      When we run sql in spark via SparkSQLDriver (thrift server, spark-sql), SQL string is siet via setJobDescription. the SparkUI SQL tab must show SQL instead of stacktrace in case setJobDescription is set which is more useful to end user. Instead it currently shows in description column the callsite shortform which is less useful

       Actual:

       

      Expected:

        Attachments

        1. image-2019-03-04-18-24-54-053.png
          123 kB
          Ajith S
        2. image-2019-03-04-18-24-27-469.png
          125 kB
          Ajith S

          Issue Links

            Activity

              People

              • Assignee:
                ajithshetty Ajith S
                Reporter:
                ajithshetty Ajith S
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: