Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-176

Improve sequential read from disk

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.1

    Description

      At now, our FileBlock cannot fully exploit the bandwidth of disk when read data sequentially (One-to-One communication pattern).
      To improve this, we can read all data sequentially at first, and decode it lazily.
      Also, we assume that the parallelism of all One-to-One read and write is 1 but it is not true. We need to fix this.

      Attachments

        Issue Links

          Activity

            People

              sanha Sanha Lee
              sanha Sanha Lee
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: