Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-753 [Umbrella] Scalability improvements
  3. TEZ-2324

Dynamic heartbeat intervals between RM and AM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Currently there is a config (10ms) which can be an issue for large clusters with many jobs heartbeating to the RM. We should be able to scale it up and down based on outstanding requests etc. e.g. if there are no outstanding requests then ping on larger intervals. The heuristics may be more sophisticated than that.

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue TEZ-119 The AM-RM heartbeat interval should not be static

          • Major - Major loss of function.
          • Reopened

          Activity

            People

              Unassigned Unassigned
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: