Hive
  1. Hive
  2. HIVE-5663

Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: File Formats
    • Labels:
    • Environment:

      Ubuntu LXC

    • Release Note:
      Refactor ORC RecordReader to use ByteBuffer APIs instead of relying on underlying array()

      Description

      The current ORC RecordReader implementation assumes array structures backing the ByteBuffers it passes around between RecordReaderImpl and Compressed/Uncompressed InStream objects.

      This patch attempts to refactor those assumptions out of both classes, allowing the future use of direct byte buffers within ORC (as might come from HDFS zero-copy readers).

      1. HIVE-5663.03.patch
        21 kB
        Gopal V
      2. HIVE-5663.02.patch
        21 kB
        Gopal V
      3. HIVE-5663.01.patch
        21 kB
        Gopal V

        Activity

        Gopal V created issue -
        Gopal V made changes -
        Field Original Value New Value
        Labels ORC
        Gopal V made changes -
        Attachment HIVE-5663.01.patch [ 12610487 ]
        Gopal V made changes -
        Attachment HIVE-5663.02.patch [ 12610575 ]
        Gopal V made changes -
        Attachment HIVE-5663.03.patch [ 12614718 ]
        Gopal V made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note Refactor ORC RecordReader to use ByteBuffer APIs instead of relying on underlying array()
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.13.0 [ 12324986 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Gopal V
            Reporter:
            Gopal V
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development