Hadoop Common
  1. Hadoop Common
  2. HADOOP-4179

Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.1
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      ALL

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.

      Description

      Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.

        Issue Links

          Activity

          Suhas Gogate created issue -
          Suhas Gogate made changes -
          Field Original Value New Value
          Attachment hadoop-vaidya-0.1.patch [ 12390152 ]
          Suhas Gogate made changes -
          Link This issue is related to HADOOP-3956 [ HADOOP-3956 ]
          Devaraj Das made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Milind Bhandarkar made changes -
          Assignee Suhas Gogate [ vgogate ]
          Milind Bhandarkar made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Enis Soztutar made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Suhas Gogate made changes -
          Attachment hadoop-vaidya-0.2.patch [ 12392443 ]
          Milind Bhandarkar made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suhas Gogate made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 0.18.0 [ 12312972 ]
          Affects Version/s 0.18.1 [ 12313357 ]
          Suhas Gogate made changes -
          Assignee Suhas Gogate [ vgogate ] Cameron Pope [ camerooni ]
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Attachment hadoop-vaidya-0.1.patch [ 12390152 ]
          Suhas Gogate made changes -
          Attachment hadoop-vaidya-0.2.patch [ 12392443 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya.0.3.patch [ 12393197 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Cameron Pope [ camerooni ] Arun C Murthy [ acmurthy ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya.0.3.patch [ 12393197 ]
          Suhas Gogate made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_branch.0.19.0.patch [ 12393267 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_trunk.patch [ 12393268 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Owen O'Malley made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Fix Version/s 0.20.0 [ 12313438 ]
          Assignee Arun C Murthy [ acmurthy ] Suhas Gogate [ vgogate ]
          Owen O'Malley made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_trunk.patch [ 12393268 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_branch.0.19.0.patch [ 12393267 ]
          Suhas Gogate made changes -
          Attachment hadoop-vaidya-trunk.patch [ 12394120 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.19.0 [ 12313211 ]
          Fix Version/s 0.20.0 [ 12313438 ]
          Suhas Gogate made changes -
          Fix Version/s 0.20.0 [ 12313438 ]
          Fix Version/s 0.19.0 [ 12313211 ]
          Suhas Gogate made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Attachment hadoop-vaidya-trunk.patch [ 12394120 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_0200.patch [ 12394453 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suhas Gogate made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_0200-1.patch [ 12394648 ]
          Suhas Gogate made changes -
          Attachment hadoop_vaidya_0200.patch [ 12394453 ]
          Suhas Gogate made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Owen O'Malley made changes -
          Resolution Fixed [ 1 ]
          Hadoop Flags [Reviewed]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Robert Chansler made changes -
          Release Note Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Owen O'Malley made changes -
          Component/s contrib/chukwa [ 12312445 ]
          Allen Wittenauer made changes -
          Link This issue duplicates MAPREDUCE-2823 [ MAPREDUCE-2823 ]

            People

            • Assignee:
              Suhas Gogate
              Reporter:
              Suhas Gogate
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development