VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As schedulers are improved with various new capabilities, more configurations which tunes the schedulers starts to take actions such as limit assigning containers to an application, or introduce delay to allocate container etc.
      There are no clear information passed down from scheduler to outerworld under these various scenarios. This makes debugging very tougher.

      This ticket is an effort to introduce more defined states on various parts in scheduler where it skips/rejects container assignment, activate application etc. Such information will help user to know whats happening in scheduler.

      Attaching a short proposal for initial discussion. We would like to improve on this as we discuss.

      Attachments

        1. YARN-4091-branch-2.001.patch
          161 kB
          Wangda Tan
        2. YARN-4091.8.patch
          160 kB
          Chen Ge
        3. YARN-4091.7.patch
          161 kB
          Chen Ge
        4. app_activities v2.json
          2 kB
          Chen Ge
        5. node_activities v2.json
          1 kB
          Chen Ge
        6. YARN-4091.6.patch
          161 kB
          Chen Ge
        7. YARN-4091.5.patch
          159 kB
          Chen Ge
        8. YARN-4091.5.patch
          159 kB
          Chen Ge
        9. SchedulerActivityManager-TestReport v2.pdf
          232 kB
          Sunil G
        10. SchedulerActivityManager-TestReport.pdf
          107 kB
          Sunil G
        11. YARN-4091.4.patch
          155 kB
          Chen Ge
        12. app_activities.json
          5 kB
          Chen Ge
        13. node_activities.json
          2 kB
          Chen Ge
        14. YARN-4091.3.patch
          154 kB
          Chen Ge
        15. YARN-4091.2.patch
          153 kB
          Chen Ge
        16. YARN-4091.1.patch
          152 kB
          Chen Ge
        17. YARN-4091.preliminary.1.patch
          120 kB
          Chen Ge
        18. YARN-4091-design-doc-v1.pdf
          288 kB
          Wangda Tan
        19. Improvement on debugdiagnostic information - YARN.pdf
          87 kB
          Sunil G

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ChenGe Chen Ge
            sunilg Sunil G
            Votes:
            1 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment