[LENS-661] Add Weighted Driver selector for selecting driver among hive and spark drivers

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.5
• Fix Version/s: 2.6
• Component/s: driver-hive
• Assignee: Anshul Gupta
• Reporter: Raju Bairishetti
• Created: 15/Jul/15 01:16
• Updated: 31/May/16 15:51
• Resolved: 31/May/16 14:44

Description

Spark Driver also uses hive thrift server as an execution engine. Both spark and hive drivers are eligible for executing the same cube query. Right now, Jdbc has Query cost 0.0 and Hive driver has 1.0. Spark driver also uses same query cost as hive driver which is 1.0.

We can introduce a weighted driver selector which will submit configured % of queries to spark driver for execution.