Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20932

Vectorize Druid Storage Handler Reader

    XMLWordPrintableJSON

Details

    Description

      This patch aims at adding support for vectorize read of data from Druid to Hive.

      t3rmin4t0r suggested that this will improve the performance of the top level operators that supports vectorization.

      As a first cut am just adding a wrapper around the existing Record Reader to read up to 1024 row at a time. 

      Future work will be to avoid going via old reader and convert straight the Json (smile format) to Vector primitive types. 

      Attachments

        1. HIVE-20932.patch
          36 kB
          Slim Bouguerra
        2. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        3. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        4. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        5. HIVE-20932.7.patch
          30 kB
          Slim Bouguerra
        6. HIVE-20932.6.patch
          30 kB
          Slim Bouguerra
        7. HIVE-20932.5.patch
          30 kB
          Slim Bouguerra
        8. HIVE-20932.4.patch
          247 kB
          Slim Bouguerra
        9. HIVE-20932.3.patch
          193 kB
          Slim Bouguerra

        Issue Links

          links to

          Web Link GitHub Pull Request #493

          Web Link RB Link

          There are no Sub-Tasks for this issue.

          Activity

            People

              bslim Slim Bouguerra
              bslim Slim Bouguerra
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: