Hive
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4370

Change ORC tree readers to return batches of rows instead of a row

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: vectorization-branch
    • Fix Version/s: vectorization-branch, 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Change ORC Record reader and Tree readers to return a set of Rows instead of a row.

      1. HIVE-4370.1.patch
        31 kB
        Sarvesh Sakalanaga
      2. HIVE-4370.2.patch
        32 kB
        Sarvesh Sakalanaga
      3. HIVE-4370.3.patch
        33 kB
        Sarvesh Sakalanaga
      4. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga
      5. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga
      6. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga

        Activity

        Hide
        Sarvesh Sakalanaga added a comment -

        The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.

        Show
        Sarvesh Sakalanaga added a comment - The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.
        Hide
        Sarvesh Sakalanaga added a comment -
        Show
        Sarvesh Sakalanaga added a comment - Review available at https://reviews.apache.org/r/10712/
        Hide
        Sarvesh Sakalanaga added a comment -

        Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header

        Show
        Sarvesh Sakalanaga added a comment - Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header
        Hide
        Ashutosh Chauhan added a comment -

        Patch is not applying cleanly. Can you please rebase it?

        Show
        Ashutosh Chauhan added a comment - Patch is not applying cleanly. Can you please rebase it?
        Hide
        Sarvesh Sakalanaga added a comment -

        Sure. Attached a new patch which is rebased.

        Show
        Sarvesh Sakalanaga added a comment - Sure. Attached a new patch which is rebased.
        Hide
        Sarvesh Sakalanaga added a comment -

        Hi Ashutosh,
        Sorry about that. Can you try the one attached?

        Thanks,
        Sarvesh

        Show
        Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
        Hide
        Sarvesh Sakalanaga added a comment -

        Hi Ashutosh,
        Sorry about that. Can you try the one attached?

        Thanks,
        Sarvesh

        Show
        Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
        Hide
        Ashutosh Chauhan added a comment -

        Patch checked-in vector branch. Thanks, Sarvesh!

        Show
        Ashutosh Chauhan added a comment - Patch checked-in vector branch. Thanks, Sarvesh!

          People

          • Assignee:
            Sarvesh Sakalanaga
            Reporter:
            Sarvesh Sakalanaga
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development