Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-188

Parquet writes columns out of order (compared to the schema)

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • parquet-mr
    • None

    Description

      When building from master, parquet seems to write row groups with the columns in arbitrary orders, not in the same order as the schema. This appears to happen regardless of the OutputFormat or WriteSupport used.

      This breaks implementations that assume the columns will be in a specific order, in particular impala.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rdblue Ryan Blue Assign to me
            colinmarc Colin Marc
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment