Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25074

Implement maxNumConcurrentTasks() in MesosFineGrainedSchedulerBackend

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • 2.4.0
    • None
    • Spark Core

    Description

      We added a new method `maxNumConcurrentTasks()` to `SchedulerBackend` to get the max number of tasks that can be concurrent launched currently. However the method is not implemented in `MesosFineGrainedSchedulerBackend`, so submit a job containing barrier stage shall always fail fast with `MesosFineGrainedSchedulerBackend` resource manager.

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            jiangxb1987 Xingbo Jiang
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment