Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6669

Jobs with encrypted spills don't tolerate AM failures

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Critical
          • Resolution: Duplicate
          • Affects Version/s: 2.8.0
          • Fix Version/s: None
          • Component/s: mr-am
          • Labels:
            None
          • Target Version/s:

            Description

            The key used for encrypting intermediate data is not persisted anywhere, and hence can't be recovered the same way other MR jobs can be. We should support recovering these jobs as well, hopefully without having to re-run completed tasks.

              Attachments

                Issue Links

                duplicates

                Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6638 Do not attempt to recover progress from previous job attempts if spill encryption is enabled

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      haibochen Haibo Chen
                      Reporter:
                      kasha Karthik Kambatla
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      4 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: