Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1484 Host affinity improvements for YARN
  3. SAMZA-1687

Prioritize preferred host requests over ANY-HOST requests

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.1
    • None
    • None

    Description

      Yarn enforces these two checks:
      1. ANY_HOST requests should always be made with relax-locality = true
      2. A request with relax-locality = false should not be in the same priority as another with relax-locality = true

      Since the Samza AM makes preferred-host requests with relax-locality = false, it follows that ANY_HOST requests should specify a different priority-level. We can safely set priority of preferred-host requests to be higher than any-host requests since data-locality is critical.

      Attachments

        Issue Links

          Activity

            People

              jagadish1989@gmail.com Jagadish
              jagadish1989@gmail.com Jagadish
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: