Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-467

Collect information about number of tasks succeeded / total per time unit for a tasktracker.

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Provide ability to collect statistics about tasks completed and succeeded for each tracker in time windows. The statistics is available on the jobtrackers' nodes UI page.

      Description

      Collecting information of number of tasks succeeded / total per tasktracker and being able to see these counts per hour, day and since start time will help reason about things like the blacklisting strategy.

      1. 5931_v1.patch
        28 kB
        Sharad Agarwal
      2. 5931_v2.patch
        31 kB
        Sharad Agarwal
      3. 5931_v3.patch
        15 kB
        Sharad Agarwal
      4. 467_v4.patch
        19 kB
        Sharad Agarwal
      5. 467_v5.patch
        19 kB
        Sharad Agarwal
      6. 467_v6.patch
        19 kB
        Sharad Agarwal
      7. 467_v7.patch
        19 kB
        Sharad Agarwal
      8. 467_branch_0.20.patch
        19 kB
        Sharad Agarwal

        Activity

        Hemanth Yamijala created issue -
        Sharad Agarwal made changes -
        Field Original Value New Value
        Assignee Sharad Agarwal [ sharadag ]
        Sharad Agarwal made changes -
        Attachment 5931_v1.patch [ 12410381 ]
        Sharad Agarwal made changes -
        Attachment 5931_v2.patch [ 12410757 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.21.0 [ 12313563 ]
        Sharad Agarwal made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Sharad Agarwal made changes -
        Attachment 5931_v3.patch [ 12411062 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Owen O'Malley made changes -
        Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
        Key HADOOP-5931 MAPREDUCE-467
        Component/s mapred [ 12310690 ]
        Fix Version/s 0.21.0 [ 12313563 ]
        Sharad Agarwal made changes -
        Attachment 467_v4.patch [ 12411499 ]
        Sharad Agarwal made changes -
        Attachment 467_v5.patch [ 12412043 ]
        Sharad Agarwal made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Sharad Agarwal made changes -
        Attachment 467_v6.patch [ 12412242 ]
        Sharad Agarwal made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Sharad Agarwal made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Sharad Agarwal made changes -
        Attachment 467_v7.patch [ 12413002 ]
        Sharad Agarwal made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12314045 ]
        Resolution Fixed [ 1 ]
        Sharad Agarwal made changes -
        Release Note Provide ability to collect statistics about tasks completed and succeeded for each tracker in time windows. The statistics is available on the jobtrackers' nodes UI page.
        Issue Type Improvement [ 4 ] New Feature [ 2 ]
        Sharad Agarwal made changes -
        Attachment 467_branch_0.20.patch [ 12413284 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Sharad Agarwal
            Reporter:
            Hemanth Yamijala
          • Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development