Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-149 [Umbrella] ResourceManager (RM) Fail-over
  3. YARN-1410

Handle RM fails over after getApplicationID() and before submitApplication().

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      App submission involves
      1) creating appId
      2) using that appId to submit an ApplicationSubmissionContext to the user.
      The client may have obtained an appId from an RM, the RM may have failed over, and the client may submit the app to the new RM.
      Since the new RM has a different notion of cluster timestamp (used to create app id) the new RM may reject the app submission resulting in unexpected failure on the client side.

      The same may happen for other 2 step client API operations.

        Attachments

        1. YARN-1410.1.patch
          19 kB
          Xuan Gong
        2. YARN-1410.10.patch
          34 kB
          Xuan Gong
        3. YARN-1410.10.patch
          33 kB
          Xuan Gong
        4. YARN-1410.2.patch
          11 kB
          Xuan Gong
        5. YARN-1410.2.patch
          12 kB
          Xuan Gong
        6. YARN-1410.3.patch
          14 kB
          Xuan Gong
        7. YARN-1410.4.patch
          18 kB
          Xuan Gong
        8. YARN-1410.5.patch
          15 kB
          Xuan Gong
        9. YARN-1410.6.patch
          6 kB
          Xuan Gong
        10. YARN-1410.7.patch
          6 kB
          Xuan Gong
        11. YARN-1410.8.patch
          16 kB
          Xuan Gong
        12. YARN-1410.9.patch
          16 kB
          Xuan Gong
        13. YARN-1410-outline.patch
          5 kB
          Xuan Gong

          Issue Links

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                bikassaha Bikas Saha
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 48h
                  48h
                  Remaining:
                  Remaining Estimate - 48h
                  48h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified