Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6669

Jobs with encrypted spills don't tolerate AM failures

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 2.8.0
    • Fix Version/s: None
    • Component/s: mr-am
    • Labels:
      None
    • Target Version/s:

      Description

      The key used for encrypting intermediate data is not persisted anywhere, and hence can't be recovered the same way other MR jobs can be. We should support recovering these jobs as well, hopefully without having to re-run completed tasks.

        Attachments

          Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6638 Do not attempt to recover progress from previous job attempts if spill encryption is enabled

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                haibochen Haibo Chen
                Reporter:
                kasha Karthik Kambatla
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: