Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32986

Add bucket scan info in explain output of FileSourceScanExec

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 3.1.0
    • 3.3.0
    • SQL
    • None

    Description

      As a followup from discussion in https://github.com/apache/spark/pull/29804#discussion_r493229395 , currently for `FileSourceScanExec` explain output, there's no information to indicate whether the table is read as bucketed table. And if not read as bucketed table, what's the reason behind it. Add this info into `FileSourceScanExec` explain output, can help users/developers understand query plan more easily without spending a lot of time debugging why table is not read as bucketed table.

      Attachments

        Activity

          People

            chengsu Cheng Su
            chengsu Cheng Su
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: