Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23034

Display tablename for `HiveTableScan` node in UI

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.2.1
    • 2.4.0
    • SQL, Web UI
    • None

    Description

      For queries which scan multiple tables, it will be convenient if the DAG shown in Spark UI also showed which table is being scanned. This will make debugging easier. For this JIRA, I am scoping those for hive table scans only. For Spark native tables, the table scan node is abstracted out as a `WholeStageCodegen` node (which might be doing more things besides table scan).

      Attachments

        Activity

          People

            maropu Takeshi Yamamuro
            tejasp Tejas Patil
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: