Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-345 Complete implementation for YARN AM HA
  3. REEF-1412

Use a two-file approach for DFSEvaluatorLogOverwriteWriter

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.16
    • None

    Description

      A problem that needs to be addressed is that the DFSEvaluatorLogOverwriteWriter currently deletes the old EvaluatorChangesLog prior to writing the new one. Instead, we should use a two-file approach, where an alternative file, EvaluatorChangesLog.alt, is used in tandem with EvaluatorChangesLog.
      On read, the newest between EvaluatorChangesLog and EvaluatorChangesLog.alt should always be read.
      On write, we always overwrite the older file between EvaluatorChangesLog and EvaluatorChangesLog.alt.

      Attachments

        Issue Links

          Activity

            People

              afchung90 Andrew Chung
              afchung90 Andrew Chung
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: