Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-477

Implement a model that represent a task level exeuction time with statistical analysis

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None

    Description

      The current SimulatedTaskExecutor is hardly available. because it needs actual metric to predict execution time. To increase utilization, we need new model that predicts a task level execution time with statistical analysis. 

      Some of the related TODOs are as follows:

      • Find factors that affect a task level execution time. with loose grid search.
      • Infer the most suitable model with tight grid search. 

      Attachments

        Issue Links

        is required by

        Umbrella - An overarching type made of sub-tasks NEMO-464 Implement an accurate task execution simulator to predict distributed data processing execution

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            Lemarais Lee Hae Dong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment