Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-446

Optimize Parallelism Of SourceVertex

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None

    Description

      While intermediate vertices use partition concept to split data into tasks, source vertices use Readables instead. Extend sampling logic to cover source vertices. This will increase the effect of DTS to another level.

      Attachments

        Issue Links

          Blocked

          Umbrella - An overarching type made of sub-tasks NEMO-441 Dynamic Task Sizing on Nemo

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              hwarim Hwarim Hyun
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: