Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-186 Implement unsupported RDD persistence option
  3. NEMO-191

Report the actual state of cached data to optimizer

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.2
    • Labels:

      Description

      The runtime should report the actual state of cached data to optimizer.

      If not, our optimizer will regard that all produced cached data is available even if some block may be unavailable. In this case, the cached data will be reproduced through our fault recovery procedure. However, it would be better to notify the unavailability of the data early and avoid the fault recovery procedure.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sanha Sanha Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: