Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20486

Kafka: Use Row SerDe + vectorization

    XMLWordPrintableJSON

Details

    Description

      KafkaHandler returns unvectorized rows which causes the operators downstream to be slower and sub-optimal.

      Hive has a vectorization shim which allows Kafka streams without complex projections to be wrapped into a vectorized reader via hive.vectorized.use.row.serde.deserialize.

      Attachments

        1. HIVE-20486.3.patch
          80 kB
          Slim Bouguerra
        2. HIVE-20486.3.patch
          80 kB
          Slim Bouguerra
        3. HIVE-20486.4.patch
          59 kB
          Slim Bouguerra
        4. HIVE-20486.4.patch
          59 kB
          Slim Bouguerra
        5. HIVE-20486.patch
          88 kB
          Slim Bouguerra

        Issue Links

          requires

          New Feature - A new feature of the product, which has yet to be developed. HIVE-20377 Hive Kafka Storage Handler

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB Link

          There are no Sub-Tasks for this issue.

          Activity

            People

              bslim Slim Bouguerra
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: