Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3086

Make NodeManager memory configurable in MiniYARNCluster

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.7.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Apache Flink has a build-in YARN client to deploy it to YARN clusters.
      Recently, we added more tests for the client, using the MiniYARNCluster.

      One of the tests is requesting more containers than available. This test works well on machines with enough memory, but on travis-ci (our test environment), the available main memory is limited to 3 GB.
      Therefore, I want to set custom amount of memory for each NodeManager.
      Right now, the NodeManager memory is hardcoded to 4GB.

      As discussed on the yarn-dev list, I'm going to create a patch for this issue.

        Attachments

        1. YARN-3086.patch
          3 kB
          Robert Metzger
        2. YARN-3086-2.patch
          3 kB
          Robert Metzger

          Issue Links

            Activity

              People

              • Assignee:
                rmetzger Robert Metzger
                Reporter:
                rmetzger Robert Metzger
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: