Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3086

Make NodeManager memory configurable in MiniYARNCluster

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.6.0
    • 2.7.0
    • test
    • None
    • Reviewed

    Description

      Apache Flink has a build-in YARN client to deploy it to YARN clusters.
      Recently, we added more tests for the client, using the MiniYARNCluster.

      One of the tests is requesting more containers than available. This test works well on machines with enough memory, but on travis-ci (our test environment), the available main memory is limited to 3 GB.
      Therefore, I want to set custom amount of memory for each NodeManager.
      Right now, the NodeManager memory is hardcoded to 4GB.

      As discussed on the yarn-dev list, I'm going to create a patch for this issue.

      Attachments

        1. YARN-3086-2.patch
          3 kB
          Robert Metzger
        2. YARN-3086.patch
          3 kB
          Robert Metzger

        Issue Links

          is required by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-1439 Enable all YARN tests on Travis

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              rmetzger Robert Metzger
              rmetzger Robert Metzger
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: