Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6940

CTAS partition parquet file with non existant columns

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.14.0
    • Fix Version/s: None
    • Component/s: Metadata, Storage - Parquet
    • Labels:
      None

      Description

      Drill allows to create parquet files with partition and metadata that allow potential pruning.

      Currently the "PARTITION BY" can only apply on present-column.

      It will be useful to have the possibility to allow PARTITION BY on "non-present data" or "computed data"

      Examples :

      • I have a,b and c, and I want to put only "b" and "c" in the parquet but partition on "a"
      • I have a,b and c, and I want to put "a", "b" and "c" in the parquet and partition NOT on a but on myfct(a)

       

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              benj641 benj
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: