Hadoop Common
  1. Hadoop Common
  2. HADOOP-4179

Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.1
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      ALL

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.

      Description

      Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.

        Issue Links

          Activity

            People

            • Assignee:
              Suhas Gogate
              Reporter:
              Suhas Gogate
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development