Details
-
Task
-
Status: Resolved
-
Trivial
-
Resolution: Not A Bug
-
None
-
None
Description
I want to understand how can we enable the flag "sortedArray" information in metadata while writing a row group or column
I am exploring parquet.thrift to understand more about metadata,
I observed a field in metadata which is related to below struct in parquet.thrift
I am wondering how to set these fields from parquet while writing a column or rowgroup
struct SortingColumn
{ /** The column index (in this row group) **/ 1: required i32 column_idx /** If true, indicates this column is sorted in descending order. **/ 2: required bool descending /** If true, nulls will come before non-null values, otherwise, * nulls go at the end. */ 3: required bool nulls_first }