Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8080

YARN native service should support component restart policy

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1
    • None
    • None

    Description

      Existing native service assumes the service is long running and never finishes. Containers will be restarted even if exit code == 0.

      To support boarder use cases, we need to allow restart policy of component specified by users. Propose to have following policies:
      1) Always: containers always restarted by framework regardless of container exit status. This is existing/default behavior.
      2) Never: Do not restart containers in any cases after container finishes: To support job-like workload (for example Tensorflow training job). If a task exit with code == 0, we should not restart the task. This can be used by services which is not restart/recovery-able.
      3) On-failure: Similar to above, only restart task with exitcode != 0.

      Behaviors after component instance finalize (Succeeded or Failed when restart_policy != ALWAYS):
      1) For single component, single instance: complete service.
      2) For single component, multiple instance: other running instances from the same component won't be affected by the finalized component instance. Service will be terminated once all instances finalized.
      3) For multiple components: Service will be terminated once all components finalized.

      Attachments

        1. YARN-8080.001.patch
          16 kB
          Wangda Tan
        2. YARN-8080.002.patch
          14 kB
          Wangda Tan
        3. YARN-8080.003.patch
          15 kB
          Wangda Tan
        4. YARN-8080.005.patch
          32 kB
          Wangda Tan
        5. YARN-8080.006.patch
          37 kB
          Wangda Tan
        6. YARN-8080.007.patch
          47 kB
          Suma Shivaprasad
        7. YARN-8080.009.patch
          84 kB
          Suma Shivaprasad
        8. YARN-8080.010.patch
          88 kB
          Suma Shivaprasad
        9. YARN-8080.011.patch
          89 kB
          Suma Shivaprasad
        10. YARN-8080.012.patch
          92 kB
          Suma Shivaprasad
        11. YARN-8080.013.patch
          93 kB
          Suma Shivaprasad
        12. YARN-8080.014.patch
          94 kB
          Suma Shivaprasad
        13. YARN-8080.015.patch
          93 kB
          Suma Shivaprasad
        14. YARN-8080.016.patch
          96 kB
          Suma Shivaprasad
        15. YARN-8080.017.patch
          97 kB
          Suma Shivaprasad

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            suma.shivaprasad Suma Shivaprasad Assign to me
            leftnoteasy Wangda Tan
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment