Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33392 Align DSv2 commands to DSv1 implementation
  3. SPARK-33509

List partition by names from V2 tables that support partition management

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • SQL
    • None

    Description

      Currently, the SupportsPartitionManagement interface exposes only the listPartitionIdentifiers() method which does not allow to list partition by names. So, it is hard to implement:

      SHOW PARTITIONS table PARTITION(month=2)
      

      from the table like:

      CREATE TABLE $table (price int, qty int, year int, month int)
      USING parquet
      partitioned by (year, month)
      

      because listPartitionIdentifiers() requires to specify value for year .

      Attachments

        Activity

          People

            maxgekk Max Gekk
            maxgekk Max Gekk
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: