Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-623

DeltaByteArrayReader has incorrect skip behaviour

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.8.1
    • Fix Version/s: 1.9.0, 1.8.2
    • Component/s: None
    • Labels:
      None

      Description

      When reading delta encoded columns (v2 API) and skipping values the read fails (with differing exceptions). This is because the reader needs the last value but the skip logic is not managing this.

      A modified DeltaByteArrayReader which calls readBytes() on skip() does fix the reading. Not sure if there is a more efficient solution possible then simply invoking readBytes().

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              rdblue Ryan Blue
              Reporter:
              oae Johannes Zillmann

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment