Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6808

Log map attempts as part of shuffle handler audit log

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.9.0, 3.0.0-alpha4, 2.8.3
    • None
    • None
    • Reviewed

    Description

      With the introduction tez, multiple unrelated reducers in the same job will have the same id. The audit log won't be able to distinguish which map attempt the reduce was fetching. This jira is to discuss the possibility to add map attempts logging to distinguish between the two.

      Attachments

        1. MAPREDUCE-6808_v2.patch
          1 kB
          Gergő Pásztor
        2. MAPREDUCE-6808_v1.patch
          1 kB
          Gergő Pásztor

        Issue Links

          relates to

          Sub-task - The sub-task of the issue TEZ-3532 Backport MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log

          • Major - Major loss of function.
          • Closed

          Activity

            People

              pairg Gergő Pásztor
              jeagles Jonathan Turner Eagles
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: