Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5663

Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • File Formats
    • Ubuntu LXC

    • Refactor ORC RecordReader to use ByteBuffer APIs instead of relying on underlying array()

    Description

      The current ORC RecordReader implementation assumes array structures backing the ByteBuffers it passes around between RecordReaderImpl and Compressed/Uncompressed InStream objects.

      This patch attempts to refactor those assumptions out of both classes, allowing the future use of direct byte buffers within ORC (as might come from HDFS zero-copy readers).

      Attachments

        1. HIVE-5663.03.patch
          21 kB
          Gopal Vijayaraghavan
        2. HIVE-5663.02.patch
          21 kB
          Gopal Vijayaraghavan
        3. HIVE-5663.01.patch
          21 kB
          Gopal Vijayaraghavan

        Activity

          People

            gopalv Gopal Vijayaraghavan
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: