Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4505

[Pig on Tez] Auto adjust AM memory can hit OOM with 3.5GXmx

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • None
    • None
    • Reviewed

    Description

      If the cluster is big and can launch many containers, Tez can try to create more threads to talk to the nodes and that can cause java.lang.OutOfMemoryError: unable to create new native thread as there is only 512MB of native memory (4GB limit due to 32-bit jvm) to create threads.

      Attachments

        1. PIG-4505-1.patch
          4 kB
          Rohini Palaniswamy

        Activity

          People

            rohini Rohini Palaniswamy
            rohini Rohini Palaniswamy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: