Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20560

Set hive.llap.memory.oversubscription.max.executors.per.query to be 1/3rd of num of executors per node

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      Unless hive.llap.memory.oversubscription.max.executors.per.query is not specified by the user,
      it should be calculated like this:

      hive.llap.memory.oversubscription.max.executors.per.query = min(max(1, int(hive.llap.daemon.num.executors / 3)),8)
      

      In container mode it remains 3 (unless specified otherwise).

      Attachments

        1. HIVE-20560.03.patch
          10 kB
          Miklos Gergely
        2. HIVE-20560.02.patch
          9 kB
          Miklos Gergely
        3. HIVE-20560.01.patch
          6 kB
          Miklos Gergely

        Activity

          People

            mgergely Miklos Gergely
            mgergely Miklos Gergely
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: