Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5355 YARN Timeline Service v.2: alpha 2
  3. YARN-5841

Report only local collectors on node upon resync with RM after RM fails over

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: timelineserver
    • Labels:
      None

      Description

      As per discussion on YARN-3359, we can potentially optimize reporting of collectors to RM after RM fails over.

      Currently NM would report all the collectors known to itself in HB after resync with RM. This would mean many NMs' may pretty much report similar set of collector infos in first NM HB on reconnection.

      This JIRA is to explore how to optimize this flow and if possible, fix it.

        Attachments

          Activity

            People

            • Assignee:
              haibochen Haibo Chen
              Reporter:
              varun_saxena Varun Saxena
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: