[HIVE-20932] Vectorize Druid Storage Handler Reader

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Druid integration
• Labels: pull-request-available
• Assignee: Slim Bouguerra
• Reporter: Slim Bouguerra
• Created: 16/Nov/18 15:00
• Updated: 17/Nov/22 08:54
• Resolved: 27/Nov/18 17:22

Description

This patch aims at adding support for vectorize read of data from Druid to Hive.

t3rmin4t0r suggested that this will improve the performance of the top level operators that supports vectorization.

As a first cut am just adding a wrapper around the existing Record Reader to read up to 1024 row at a time. 

Future work will be to avoid going via old reader and convert straight the Json (smile format) to Vector primitive types. 

Issue Links

• links to: GitHub Pull Request #493
• links to: RB Link

Sub-Tasks

• Avoid the un-needed object creation within hotloop: Resolved