Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14549 HiveServer2: Improve HiveServer2 JDBC/ODBC ResultSet performance - part2
  3. HIVE-10438

HiveServer2: Enable Type specific ResultSet compression

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: None
    • Component/s: Hive, Thrift API
    • Labels:
      None

      Description

      This JIRA proposes an architecture for enabling ResultSet compression which uses an external plugin.

      The patch has three aspects to it:
      0. An architecture for enabling ResultSet compression with external plugins
      1. An example plugin to demonstrate end-to-end functionality
      2. A container to allow everyone to write and test ResultSet compressors with a query submitter (https://github.com/xiaom/hs2driver)

      Also attaching a design document explaining the changes, experimental results document, and a pdf explaining how to setup the docker container to observe end-to-end functionality of ResultSet compression.

      https://reviews.apache.org/r/35792/ Review board link.

        Attachments

        1. Proposal-rscompressor.pdf
          70 kB
          Rohit Dholakia
        2. hs2driver-master.zip
          63 kB
          Rohit Dholakia
        3. Results_Snappy_protobuf_TBinary_TCompact.pdf
          31 kB
          Rohit Dholakia
        4. HIVE-10438.patch
          136 kB
          Rohit Dholakia
        5. HIVE-10438-1.patch
          146 kB
          Rohit Dholakia
        6. hs2ResultSetCompressor.zip
          17 kB
          Rohit Dholakia
        7. README.txt
          0.7 kB
          Rohit Dholakia

          Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10439 Architecture for ResultSet Compression via external plugin

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10440 Architecture for ResultSet Compression via external plugin

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-12049 HiveServer2: Provide an option to write serialized thrift objects in final tasks

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                kliew Kevin Liew
                Reporter:
                rohitdholakia Rohit Dholakia
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: