Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23744 Reduce query startup latency
  3. HIVE-23747

Increase the number of parallel tasks sent to daemons from am

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The number of inflight tasks from AM to a single executor is hardcoded to 1 currently(https://github.com/apache/hive/blob/master/llap-client/src/java/org/apache/hadoop/hive/llap/tez/LlapProtocolClientProxy.java#L57 ). It does not make sense to increase this right now as communication between am and daemons happen synchronously anyway. After resolving https://issues.apache.org/jira/browse/HIVE-23746 this must be increased to at least number of execution slots per daemon.

        Attachments

          Activity

            People

            • Assignee:
              mustafaiman Mustafa Iman
              Reporter:
              mustafaiman Mustafa Iman
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: