Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-446

Optimize Parallelism Of SourceVertex

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:

      Description

      While intermediate vertices use partition concept to split data into tasks, source vertices use Readables instead. Extend sampling logic to cover source vertices. This will increase the effect of DTS to another level.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                hwarim Hwarim Hyun
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: