Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17270 Qtest results show wrong number of executors
  3. HIVE-17292

Change TestMiniSparkOnYarnCliDriver test configuration to use the configured cores

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Spark, Test
    • Labels:
      None

      Description

      Currently the hive-site.xml for the TestMiniSparkOnYarnCliDriver test defines 2 cores, and 2 executors, but only 1 is used, because the MiniCluster does not allows the creation of the 3rd container.

      The FairScheduler uses 1GB increments for memory, but the containers would like to use only 512MB. We should change the fairscheduler configuration to use only the requested 512MB

        Attachments

        1. HIVE-17292.1.patch
          23 kB
          Peter Vary
        2. HIVE-17292.2.patch
          27 kB
          Peter Vary
        3. HIVE-17292.3.patch
          28 kB
          Peter Vary
        4. HIVE-17292.5.patch
          386 kB
          Peter Vary
        5. HIVE-17292.6.patch
          32 kB
          Peter Vary
        6. HIVE-17292.7.patch
          27 kB
          Peter Vary

          Issue Links

            Activity

              People

              • Assignee:
                pvary Peter Vary
                Reporter:
                pvary Peter Vary
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: