Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-186 Implement unsupported RDD persistence option
  3. NEMO-191

Report the actual state of cached data to optimizer

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None

    Description

      The runtime should report the actual state of cached data to optimizer.

      If not, our optimizer will regard that all produced cached data is available even if some block may be unavailable. In this case, the cached data will be reproduced through our fault recovery procedure. However, it would be better to notify the unavailability of the data early and avoid the fault recovery procedure.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sanha Sanha Lee
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: