Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-144 Improve Data Plane Code
  3. NEMO-146

Simpler InputReader#read Return Type

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:

      Description

      At the moment the InputReader class provides a method

         List<CompletableFuture<DataUtil.IteratorWithNumBytes>> read();

      This is much more complex than the OutputWriter class's method

         void write(final Object element);

      As a result we have bunch of low-level logic for handling multiple futures and iterators in ParentTaskDataFetcher. We may want to move that logic into InputReader, so ParentTaskDataFetcher only has logic related to tasks.

      Something like this would be nicer

        DataUtil.IteratorWithNumBytes read();

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              johnyangk John Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: