Hive
  1. Hive
  2. HIVE-5663

Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: File Formats
    • Labels:
    • Environment:

      Ubuntu LXC

    • Release Note:
      Refactor ORC RecordReader to use ByteBuffer APIs instead of relying on underlying array()

      Description

      The current ORC RecordReader implementation assumes array structures backing the ByteBuffers it passes around between RecordReaderImpl and Compressed/Uncompressed InStream objects.

      This patch attempts to refactor those assumptions out of both classes, allowing the future use of direct byte buffers within ORC (as might come from HDFS zero-copy readers).

      1. HIVE-5663.03.patch
        21 kB
        Gopal V
      2. HIVE-5663.02.patch
        21 kB
        Gopal V
      3. HIVE-5663.01.patch
        21 kB
        Gopal V

        Activity

          People

          • Assignee:
            Gopal V
            Reporter:
            Gopal V
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development