Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2492

[MAPREDUCE] The new MapReduce API should make available task's progress to the task

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: task
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Map and Reduce task can access the attempt's overall progress via TaskAttemptContext.
    • Tags:
      mapreduce progress

      Description

      There is no way to get the task's current progress in the new MapReduce API. It would be nice to make it available so that the task (map/reduce) can use it.

      1. MAPREDUCE-2492-v1.7.patch
        29 kB
        Amar Kamat
      2. MAPREDUCE-2492-v1.6.patch
        31 kB
        Amar Kamat
      3. MAPREDUCE-2492-v1.5.patch
        31 kB
        Amar Kamat
      4. MAPREDUCE-2492-v1.4.patch
        31 kB
        Amar Kamat
      5. MAPREDUCE-2492-v1.3.patch
        30 kB
        Amar Kamat

        Issue Links

          Activity

          Amar Kamat created issue -
          Amar Kamat made changes -
          Field Original Value New Value
          Description There is now way to get the task's current progress in the new MapReduce API. It would be nice to make it available so that the task (map/reduce) can use it. Older MapRed API's exposed a getProgress() API. There is no way to get the task's current progress in the new MapReduce API. It would be nice to make it available so that the task (map/reduce) can use it.
          Amar Kamat made changes -
          Link This issue is part of MAPREDUCE-2106 [ MAPREDUCE-2106 ]
          Amar Kamat made changes -
          Link This issue incorporates MAPREDUCE-2519 [ MAPREDUCE-2519 ]
          Amar Kamat made changes -
          Link This issue incorporates MAPREDUCE-2511 [ MAPREDUCE-2511 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.3.patch [ 12479778 ]
          Amar Kamat made changes -
          Assignee Amar Kamat [ amar_kamat ]
          Amar Kamat made changes -
          Link This issue incorporates MAPREDUCE-2523 [ MAPREDUCE-2523 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.4.patch [ 12479987 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.5.patch [ 12480023 ]
          Amar Kamat made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amar Kamat made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.6.patch [ 12480084 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.6.patch [ 12480084 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.6.patch [ 12480095 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amar Kamat made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-2492-v1.7.patch [ 12480106 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amar Kamat made changes -
          Resolution Fixed [ 1 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Release Note Map and Reduce task can access the attempt's overall progress via TaskAttemptContext.
          Fix Version/s 0.23.0 [ 12315570 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development