Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5031

metrics aggregation is incorrect in database

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Redhat 5.1, Java 6

    • Reviewed

    Description

      A few problem with the aggregation SQL statements:

      hdfs throughput should be calculated by doing two level aggregation:

      First, calculate the rate for hadoop datanode metrics with accumulated vales.
      Second, sum up all datanode rate to provide a single number to represent the current cluster performance.

      Disable hod jobs utilization measurement - The data provide a rough view of the cluster performance but mostly inaccurate.
      Disable user utilization measurement generated from hod job - The data is generated from hod job metrics, and it's mostly inaccurate.

      Attachments

        1. HADOOP-5031.patch
          11 kB
          Eric Yang

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            eyang Eric Yang
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment