Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4433

Improve data loader for collecting metrics and log files from hadoop and system

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.19.0
    • None
    • None
    • Red Hat Enterprise Linux 4.5, 5, Java 6

    • Reviewed
    • Hide
      - Added startup and shutdown script
      - Added torque metrics data loader
      - Improve handling of Exec Plugin
      - Added Test cases for File Tailing Adaptors
      - Added Test cases for Start streaming at specific offset
      Show
      - Added startup and shutdown script - Added torque metrics data loader - Improve handling of Exec Plugin - Added Test cases for File Tailing Adaptors - Added Test cases for Start streaming at specific offset

    Description

      Enhancement should include:

      • Ability to stream /var/log/messages
      • Better handling of startup and shutdown chukwa processes
      • Ability to monitor torque/hod allocated clusters
      • Add serialization and deserialization of hadoop metrics to JSON log files.

      Attachments

        1. HADOOP-4433.patch
          131 kB
          Eric Yang
        2. HADOOP-4433-2.patch
          127 kB
          Eric Yang

        Issue Links

          Activity

            People

              eyang Eric Yang
              eyang Eric Yang
              Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 96h
                  96h
                  Remaining:
                  Remaining Estimate - 96h
                  96h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified