Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6808

Log map attempts as part of shuffle handler audit log

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With the introduction tez, multiple unrelated reducers in the same job will have the same id. The audit log won't be able to distinguish which map attempt the reduce was fetching. This jira is to discuss the possibility to add map attempts logging to distinguish between the two.

        Attachments

        1. MAPREDUCE-6808_v1.patch
          1 kB
          Gergő Pásztor
        2. MAPREDUCE-6808_v2.patch
          1 kB
          Gergő Pásztor

          Issue Links

            Activity

              People

              • Assignee:
                pairg Gergő Pásztor
                Reporter:
                jeagles Jonathan Eagles
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: