Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5663

Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: File Formats
    • Labels:
    • Environment:

      Ubuntu LXC

    • Release Note:
      Refactor ORC RecordReader to use ByteBuffer APIs instead of relying on underlying array()

      Description

      The current ORC RecordReader implementation assumes array structures backing the ByteBuffers it passes around between RecordReaderImpl and Compressed/Uncompressed InStream objects.

      This patch attempts to refactor those assumptions out of both classes, allowing the future use of direct byte buffers within ORC (as might come from HDFS zero-copy readers).

        Attachments

        1. HIVE-5663.03.patch
          21 kB
          Gopal V
        2. HIVE-5663.02.patch
          21 kB
          Gopal V
        3. HIVE-5663.01.patch
          21 kB
          Gopal V

          Activity

            People

            • Assignee:
              gopalv Gopal V
              Reporter:
              gopalv Gopal V
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: