Uploaded image for project: 'Slider'
  1. Slider
  2. SLIDER-611 Über-JIRA : placement phase 2
  3. SLIDER-799

AM to decide when to relax placement policy from specific host to rack/cluster

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Slider 0.70
    • Fix Version/s: Slider 0.80
    • Component/s: appmaster
    • Labels:
      None
    • Sprint:
      Slider Feb #1, Slider April #1

      Description

      If Slider asks for relaxed affinity, YARN only gives it ~1 second for free capacity to appear on a node before it falls back to non-local assignment. While this is OK for analytics throughput, it's suboptimal for placement of code such as HBase region servers.

      AM needs to take charge of the placement and decide for itself when to convert from placed to relaxed.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h Original Estimate - 24h
                  24h
                  Remaining:
                  Time Spent - 24h Remaining Estimate - 8h
                  8h
                  Logged:
                  Time Spent - 24h Remaining Estimate - 8h
                  24h