Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1372

When using uber mode, Oozie should also make the AM container size larger

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk
    • Fix Version/s: 4.1.0
    • Component/s: None
    • Labels:
      None

      Description

      OOZIE-1335 made Oozie use uber mode for the launcher job by default. We should also increase the AM container size in case the launcher job needs more memory (e.g. a Pig job).

      from Rohini Palaniswamy

      yarn.app.mapreduce.am.resource.mb and yarn.app.mapreduce.am.command-opts. yarn.app.mapreduce.am.resource.mb is easy and you can just set and overwrite. You will have to do some string manipulation with yarn.app.mapreduce.am.command-opts or append hoping the last values will take effect. Not sure if there are jvm's (IBM or openjdk) which will take the first value.

        Attachments

        1. OOZIE-1372-v4.patch
          15 kB
          Ryota Egashira
        2. OOZIE-1372-v4.patch
          15 kB
          Ryota Egashira
        3. OOZIE-1372-v3.patch
          13 kB
          Ryota Egashira
        4. OOZIE-1372-v2.patch
          12 kB
          Ryota Egashira

          Issue Links

            Activity

              People

              • Assignee:
                egashira Ryota Egashira
                Reporter:
                rkanter Robert Kanter
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: