Hive
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4370

Change ORC tree readers to return batches of rows instead of a row

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: vectorization-branch
    • Fix Version/s: vectorization-branch, 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Change ORC Record reader and Tree readers to return a set of Rows instead of a row.

      1. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga
      2. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga
      3. HIVE-4370.4.patch
        33 kB
        Sarvesh Sakalanaga
      4. HIVE-4370.3.patch
        33 kB
        Sarvesh Sakalanaga
      5. HIVE-4370.2.patch
        32 kB
        Sarvesh Sakalanaga
      6. HIVE-4370.1.patch
        31 kB
        Sarvesh Sakalanaga

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        4s 1 Sarvesh Sakalanaga 22/Apr/13 23:11
        In Progress In Progress Open Open
        4s 1 Sarvesh Sakalanaga 22/Apr/13 23:11
        Open Open Patch Available Patch Available
        5d 21h 51m 2 Sarvesh Sakalanaga 22/Apr/13 23:38
        Patch Available Patch Available Open Open
        6d 16h 42m 2 Ashutosh Chauhan 29/Apr/13 16:20
        Open Open Resolved Resolved
        1d 3h 11m 1 Ashutosh Chauhan 30/Apr/13 19:32
        Thejas M Nair made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Ashutosh Chauhan made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s vectorization-branch [ 12324334 ]
        Resolution Fixed [ 1 ]
        Hide
        Ashutosh Chauhan added a comment -

        Patch checked-in vector branch. Thanks, Sarvesh!

        Show
        Ashutosh Chauhan added a comment - Patch checked-in vector branch. Thanks, Sarvesh!
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.4.patch [ 12580985 ]
        Hide
        Sarvesh Sakalanaga added a comment -

        Hi Ashutosh,
        Sorry about that. Can you try the one attached?

        Thanks,
        Sarvesh

        Show
        Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.4.patch [ 12580984 ]
        Hide
        Sarvesh Sakalanaga added a comment -

        Hi Ashutosh,
        Sorry about that. Can you try the one attached?

        Thanks,
        Sarvesh

        Show
        Sarvesh Sakalanaga added a comment - Hi Ashutosh, Sorry about that. Can you try the one attached? Thanks, Sarvesh
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.4.patch [ 12580983 ]
        Hide
        Sarvesh Sakalanaga added a comment -

        Sure. Attached a new patch which is rebased.

        Show
        Sarvesh Sakalanaga added a comment - Sure. Attached a new patch which is rebased.
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Affects Version/s vectorization-branch [ 12324334 ]
        Hide
        Ashutosh Chauhan added a comment -

        Patch is not applying cleanly. Can you please rebase it?

        Show
        Ashutosh Chauhan added a comment - Patch is not applying cleanly. Can you please rebase it?
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.3.patch [ 12580442 ]
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.2.patch [ 12580393 ]
        Hide
        Sarvesh Sakalanaga added a comment -

        Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header

        Show
        Sarvesh Sakalanaga added a comment - Addressed comments from Scott and Eric. Review at https://reviews.apache.org/r/10712/diff/#index_header
        Sarvesh Sakalanaga made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Sarvesh Sakalanaga added a comment -
        Show
        Sarvesh Sakalanaga added a comment - Review available at https://reviews.apache.org/r/10712/
        Sarvesh Sakalanaga made changes -
        Attachment HIVE-4370.1.patch [ 12579914 ]
        Hide
        Sarvesh Sakalanaga added a comment -

        The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.

        Show
        Sarvesh Sakalanaga added a comment - The patch contains changes to ORC reader to return a batch of rows instead of a row. A new method called nextBatch() is added to ORC reader and tree readers of ORC. Currently only int,long,short,double,float,string and struct datatypes support batch processing.
        Sarvesh Sakalanaga made changes -
        Status In Progress [ 3 ] Open [ 1 ]
        Sarvesh Sakalanaga made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Sarvesh Sakalanaga made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Sarvesh Sakalanaga made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jitendra Nath Pandey made changes -
        Field Original Value New Value
        Assignee Sarvesh Sakalanaga [ sarvesh.sn ]
        Sarvesh Sakalanaga created issue -

          People

          • Assignee:
            Sarvesh Sakalanaga
            Reporter:
            Sarvesh Sakalanaga
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development