Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1508

Log a warning if Xmx is configured incorrectly.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Users may incorrectly configure Xmx for tasks. Xmx should in most cases be less than the container/task size given that YARN will kill containers that exceed the memory limits.

      Given that we already parse the java opts to detect Xmx in the java opts, it should be trivial to add a check if the value is valid and log a warning if not ( for both the Tez AM and the vertices in a DAG).

      Attachments

        1. TEZ-1508-v3.patch
          10 kB
          Jonathan Turner Eagles
        2. TEZ-1508-v2.patch
          7 kB
          Jonathan Turner Eagles
        3. TEZ-1508-v1.patch
          5 kB
          Jonathan Turner Eagles

        Activity

          People

            jeagles Jonathan Turner Eagles
            hitesh Hitesh Shah
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: