Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Adds Reduce Attempt ID to ClientTrace log messages, and adds Reduce Attempt ID to HTTP query string sent to mapOutputServlet. Extracts partition number from attempt ID.

      Description

      Current clienttrace messages from shuffles note only the destination map ID but not the source reduce ID. Having both source and destination ID of each shuffle enables full tracing of execution.

        Attachments

        1. HADOOP-6013.patch
          1 kB
          Jiaqi Tan
        2. MAPREDUCE-479.patch
          2 kB
          Jiaqi Tan
        3. MAPREDUCE-479-1.patch
          7 kB
          Jiaqi Tan
        4. MAPREDUCE-479-2.patch
          3 kB
          Jiaqi Tan
        5. MAPREDUCE-479-3.patch
          3 kB
          Jiaqi Tan
        6. MAPREDUCE-479-4.patch
          3 kB
          Jiaqi Tan

          Issue Links

            Activity

              People

              • Assignee:
                tanjiaqi Jiaqi Tan
                Reporter:
                tanjiaqi Jiaqi Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: