Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-188

Parquet writes columns out of order (compared to the schema)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      When building from master, parquet seems to write row groups with the columns in arbitrary orders, not in the same order as the schema. This appears to happen regardless of the OutputFormat or WriteSupport used.

      This breaks implementations that assume the columns will be in a specific order, in particular impala.

        Attachments

          Activity

            People

            • Assignee:
              rdblue Ryan Blue
              Reporter:
              colinmarc Colin Marc
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: