Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2459

RM crashes if App gets rejected for any reason and HA is enabled

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.1
    • Fix Version/s: 2.6.0
    • Component/s: resourcemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      If RM HA is enabled and used Zookeeper store for RM State Store.
      If for any reason Any app gets rejected and directly goes to NEW to FAILED
      then final transition makes that to RMApps and Completed Apps memory structure but that doesn't make it to State store.
      Now when RMApps default limit reaches it starts deleting apps from memory and store. In that case it try to delete this app from store and fails which causes RM to crash.

      Thanks,
      Mayank

        Attachments

        1. YARN-2459-1.patch
          3 kB
          Mayank Bansal
        2. YARN-2459-2.patch
          3 kB
          Mayank Bansal
        3. YARN-2459.3.patch
          3 kB
          Jian He
        4. YARN-2459.4.patch
          8 kB
          Jian He
        5. YARN-2459.5.patch
          8 kB
          Jian He
        6. YARN-2459.6.patch
          8 kB
          Jian He

          Activity

            People

            • Assignee:
              mayank_bansal Mayank Bansal
              Reporter:
              mayank_bansal Mayank Bansal
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: