[HIVE-20932] Vectorize Druid Storage Handler Reader

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0
• Component/s: Druid integration
• Labels: pull-request-available
• Assignee: Slim Bouguerra
• Reporter: Slim Bouguerra
• Created: 16/Nov/18 15:00
• Updated: 04/Dec/18 18:59
• Resolved: 27/Nov/18 17:22

Description

This patch aims at adding support for vectorize read of data from Druid to Hive.

Gopal V suggested that this will improve the performance of the top level operators that supports vectorization.

As a first cut am just adding a wrapper around the existing Record Reader to read up to 1024 row at a time. 

Future work will be to avoid going via old reader and convert straight the Json (smile format) to Vector primitive types. 

Issue Links

• links to: GitHub Pull Request #493
• links to: RB Link

Sub-Tasks

• Avoid the un-needed object creation within hotloop: Resolved