Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None

      Description

      observing the cluster over the last day - one thing i noticed is that small jobs (single digit tasks) are not doing a good job competing against large jobs. what seems to happen is that:

      • large job comes along and needs to wait for a while for other large jobs.
      • slots are slowly transfered from one large job to another
      • small tasks keep waiting forever.

      is this an artifact of deficit based scheduling? it seems that long pending large jobs are out-scheduling small jobs

        Activity

          People

          • Assignee:
            Matei Zaharia
            Reporter:
            Joydeep Sen Sarma
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development