Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-149 [Umbrella] ResourceManager (RM) Fail-over
  3. YARN-1410

Handle RM fails over after getApplicationID() and before submitApplication().

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • None
    • None
    • Reviewed

    Description

      App submission involves
      1) creating appId
      2) using that appId to submit an ApplicationSubmissionContext to the user.
      The client may have obtained an appId from an RM, the RM may have failed over, and the client may submit the app to the new RM.
      Since the new RM has a different notion of cluster timestamp (used to create app id) the new RM may reject the app submission resulting in unexpected failure on the client side.

      The same may happen for other 2 step client API operations.

      Attachments

        1. YARN-1410-outline.patch
          5 kB
          Xuan Gong
        2. YARN-1410.9.patch
          16 kB
          Xuan Gong
        3. YARN-1410.8.patch
          16 kB
          Xuan Gong
        4. YARN-1410.7.patch
          6 kB
          Xuan Gong
        5. YARN-1410.6.patch
          6 kB
          Xuan Gong
        6. YARN-1410.5.patch
          15 kB
          Xuan Gong
        7. YARN-1410.4.patch
          18 kB
          Xuan Gong
        8. YARN-1410.3.patch
          14 kB
          Xuan Gong
        9. YARN-1410.2.patch
          12 kB
          Xuan Gong
        10. YARN-1410.2.patch
          11 kB
          Xuan Gong
        11. YARN-1410.10.patch
          33 kB
          Xuan Gong
        12. YARN-1410.10.patch
          34 kB
          Xuan Gong
        13. YARN-1410.1.patch
          19 kB
          Xuan Gong

        Issue Links

          Activity

            People

              xgong Xuan Gong
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 48h
                  48h
                  Remaining:
                  Remaining Estimate - 48h
                  48h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified