Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4948

Pig on Tez AM use too much memory on a small cluster

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.17.0, 0.16.1
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Pig will use 1024M for AM memory even if "tez.am.resource.memory.mb" is smaller. On a small cluster such as sandbox, the total memory is very small (eg, 2g) and this will make the capacity full and not able to run any job.

        Attachments

        1. PIG-4948-1.patch
          3 kB
          Jianyong Dai
        2. PIG-4948-2.patch
          3 kB
          Jianyong Dai

          Issue Links

            Activity

              People

              • Assignee:
                daijy Jianyong Dai
                Reporter:
                daijy Jianyong Dai
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: