Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2329

Make handling yarn restarts configurable

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: None
    • Labels:
      None

      Description

      For a cluster with lot of RUNNING jobs, this overwhelms RM causing lot of blocked threads as it does ACL check on each application before applying the filter tag and that is inside a synchronized block. Hadoop team is looking at doing the filtering first outside synchronized block to limit the number of applications for which ACL check needs to be done reducing time spent in synchronized block.

        Attachments

        1. OOZIE-2329-V1.patch
          3 kB
          Purshotam Shah
        2. OOZIE-2329-V2.patch
          3 kB
          Purshotam Shah
        3. OOZIE-2329-V3.patch
          13 kB
          Purshotam Shah
        4. OOZIE-2329-V4.patch
          13 kB
          Purshotam Shah

          Activity

            People

            • Assignee:
              puru Purshotam Shah
              Reporter:
              puru Purshotam Shah
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: