Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14549 HiveServer2: Improve HiveServer2 JDBC/ODBC ResultSet performance - part2
  3. HIVE-10438

HiveServer2: Enable Type specific ResultSet compression

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.1.0
    • None
    • Hive, Thrift API
    • None

    Description

      This JIRA proposes an architecture for enabling ResultSet compression which uses an external plugin.

      The patch has three aspects to it:
      0. An architecture for enabling ResultSet compression with external plugins
      1. An example plugin to demonstrate end-to-end functionality
      2. A container to allow everyone to write and test ResultSet compressors with a query submitter (https://github.com/xiaom/hs2driver)

      Also attaching a design document explaining the changes, experimental results document, and a pdf explaining how to setup the docker container to observe end-to-end functionality of ResultSet compression.

      https://reviews.apache.org/r/35792/ Review board link.

      Attachments

        1. HIVE-10438.patch
          136 kB
          Rohit Dholakia
        2. HIVE-10438-1.patch
          146 kB
          Rohit Dholakia
        3. hs2driver-master.zip
          63 kB
          Rohit Dholakia
        4. hs2ResultSetCompressor.zip
          17 kB
          Rohit Dholakia
        5. Proposal-rscompressor.pdf
          70 kB
          Rohit Dholakia
        6. README.txt
          0.7 kB
          Rohit Dholakia
        7. Results_Snappy_protobuf_TBinary_TCompact.pdf
          31 kB
          Rohit Dholakia

        Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10439 Architecture for ResultSet Compression via external plugin

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10440 Architecture for ResultSet Compression via external plugin

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-12049 HiveServer2: Provide an option to write serialized thrift objects in final tasks

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kliew Kevin Liew
              rohitdholakia Rohit Dholakia
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: