Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1881

How to enable sorted array flag while writing a column

    XMLWordPrintableJSON

Details

    Description

      I want to understand how can we enable the flag "sortedArray" information in metadata while writing a row group or column

      I am exploring parquet.thrift to understand more about metadata,

      I observed a field in metadata which is related to below struct in parquet.thrift

      I am wondering how to set these fields from parquet while writing a column or rowgroup

      struct SortingColumn

      { /** The column index (in this row group) **/ 1: required i32 column_idx /** If true, indicates this column is sorted in descending order. **/ 2: required bool descending /** If true, nulls will come before non-null values, otherwise, * nulls go at the end. */ 3: required bool nulls_first }

      Attachments

        Activity

          People

            Unassigned Unassigned
            Khasim7 Khasim Shaik
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: