Uploaded image for project: 'Chukwa (retired)'
  1. Chukwa (retired)
  2. CHUKWA-267

Collect shuffling information from userlogs/syslog

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.2.0
    • 0.1.2, 0.2.0
    • Data Collection
    • None

    • Redhat EL 5.1, Java 6

    Description

      Hadoop uses a customized version of log4j appender (org.apache.hadoop.mapred.TaskLogAppender) for tasks. Shuffling information is written to userlogs/syslog by TaskLogAppender. For chukwa to collect shuffling information, we need to write a new TaskLogAppender to do this.

      Attachments

        1. CHUKWA-267.patch
          13 kB
          Eric Yang
        2. CHUKWA-267-1.patch
          13 kB
          Eric Yang
        3. CHUKWA-267-2.patch
          15 kB
          Eric Yang

        Activity

          People

            eyang Eric Yang
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: