Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-78

Track map reduce cluster usage through through job history and jobconf

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Environment:

      Redhat 5.1, Java 6

      Description

      Job history data and jobconf contains valuable information to determine the usage of the map reduce job cluster. The request feature is to create the following components:

      • ChukwaJobTrackerInstrumentation API to stream job history and jobconf file to Chukwa.
      • parsers to collect job data.
      • MDL dictionary to load key/value pair for Job data to database.
      • Usage report of the cluster base on user, and job queues.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                eyang Eric Yang
                Reporter:
                eyang Eric Yang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: