Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4370

Change ORC tree readers to return batches of rows instead of a row

        Details

        • Type: Sub-task
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: vectorization-branch
        • Fix Version/s: vectorization-branch, 0.13.0
        • Component/s: None
        • Labels:
          None

          Description

          Change ORC Record reader and Tree readers to return a set of Rows instead of a row.

          1. Text File
            HIVE-4370.1.patch
            31 kB
            Sarvesh Sakalanaga
          2. Text File
            HIVE-4370.2.patch
            32 kB
            Sarvesh Sakalanaga
          3. Text File
            HIVE-4370.3.patch
            33 kB
            Sarvesh Sakalanaga
          4. Text File
            HIVE-4370.4.patch
            33 kB
            Sarvesh Sakalanaga
          5. Text File
            HIVE-4370.4.patch
            33 kB
            Sarvesh Sakalanaga
          6. Text File
            HIVE-4370.4.patch
            33 kB
            Sarvesh Sakalanaga

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            Review available at https://reviews.apache.org/r/10712/

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - Review available at https://reviews.apache.org/r/10712/
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header
            Hide
            Permalink
            ashutoshc Ashutosh Chauhan added a comment -

            Patch is not applying cleanly. Can you please rebase it?

            Show
            ashutoshc Ashutosh Chauhan added a comment - Patch is not applying cleanly. Can you please rebase it?
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            Sure. Attached a new patch which is rebased.

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - Sure. Attached a new patch which is rebased.
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            Hi Ashutosh,
            Sorry about that. Can you try the one attached?

            Thanks,
            Sarvesh

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
            Hide
            Permalink
            sarvesh.sn Sarvesh Sakalanaga added a comment -

            Hi Ashutosh,
            Sorry about that. Can you try the one attached?

            Thanks,
            Sarvesh

            Show
            sarvesh.sn Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
            Hide
            Permalink
            ashutoshc Ashutosh Chauhan added a comment -

            Patch checked-in vector branch. Thanks, Sarvesh!

            Show
            ashutoshc Ashutosh Chauhan added a comment - Patch checked-in vector branch. Thanks, Sarvesh!

              People

              • Assignee:
                sarvesh.sn Sarvesh Sakalanaga
                Reporter:
                sarvesh.sn Sarvesh Sakalanaga
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development