Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: None
    • Component/s: Hive, Thrift API
    • Labels:
      None

      Description

      This JIRA proposes an architecture for enabling ResultSet compression which uses an external plugin.

      The patch has three aspects to it:
      0. An architecture for enabling ResultSet compression with external plugins
      1. An example plugin to demonstrate end-to-end functionality
      2. A container to allow everyone to write and test ResultSet compressors with a query submitter (https://github.com/xiaom/hs2driver)

      Also attaching a design document explaining the changes, experimental results document, and a pdf explaining how to setup the docker container to observe end-to-end functionality of ResultSet compression.

      https://reviews.apache.org/r/35792/ Review board link.

        Attachments

        1. HIVE-10438.patch
          136 kB
          Rohit Dholakia
        2. HIVE-10438-1.patch
          146 kB
          Rohit Dholakia
        3. hs2driver-master.zip
          63 kB
          Rohit Dholakia
        4. hs2ResultSetCompressor.zip
          17 kB
          Rohit Dholakia
        5. Proposal-rscompressor.pdf
          70 kB
          Rohit Dholakia
        6. README.txt
          0.7 kB
          Rohit Dholakia
        7. Results_Snappy_protobuf_TBinary_TCompact.pdf
          31 kB
          Rohit Dholakia

          Issue Links

            Activity

              People

              • Assignee:
                kliew Kevin Liew
                Reporter:
                rohitdholakia Rohit Dholakia
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: