Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-144 Improve Data Plane Code
  3. NEMO-146

Simpler InputReader#read Return Type

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None

    Description

      At the moment the InputReader class provides a method

         List<CompletableFuture<DataUtil.IteratorWithNumBytes>> read();

      This is much more complex than the OutputWriter class's method

         void write(final Object element);

      As a result we have bunch of low-level logic for handling multiple futures and iterators in ParentTaskDataFetcher. We may want to move that logic into InputReader, so ParentTaskDataFetcher only has logic related to tasks.

      Something like this would be nicer

        DataUtil.IteratorWithNumBytes read();

      Attachments

        Activity

          People

            Unassigned Unassigned
            johnyangk John Yang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: