Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7082

Vectorized parquet reader should create assigners only for the columns it assigns, not for scratch columns

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The code in VectorizedParquetRecordReader.next and in VectorColumnAssignFactory.buildAssigners iterates for all columns in the vectorization context trying to build an assigner for it. Scratch columns do not require assigners. Fix is to simply use the writables.length instead of outputBatch.numCols.

      Attachments

        1. HIVE-7082.1.patch
          2 kB
          Remus Rusanu

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-5771 Constant propagation optimizer for Hive

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rusanu Remus Rusanu Assign to me
            rusanu Remus Rusanu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment