Uploaded image for project: 'Apache Lens (Retired)'
  1. Apache Lens (Retired)
  2. LENS-638 Add Spark Driver
  3. LENS-661

Add Weighted Driver selector for selecting driver among hive and spark drivers

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.5
    • Fix Version/s: 2.6
    • Component/s: driver-hive
    • Labels:
      None

      Description

      Spark Driver also uses hive thrift server as an execution engine. Both spark and hive drivers are eligible for executing the same cube query. Right now, Jdbc has Query cost 0.0 and Hive driver has 1.0. Spark driver also uses same query cost as hive driver which is 1.0.

      We can introduce a weighted driver selector which will submit configured % of queries to spark driver for execution.

        Attachments

        1. rb47777.patch
          26 kB
          Anshul Gupta

          Activity

            People

            • Assignee:
              anshul.gupta Anshul Gupta
              Reporter:
              raju.bairishetti Raju Bairishetti
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: