Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5897

Add more Metrics to Namenode to capture heap usage

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: metrics
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recently we had GC issues, where Namenode used more heap than usual. There was no growth indicated by the data in current Metrics to justify the heap usage. Adding more stats such as:

      • Counter to track blocks that are pending deletion
      • BlocksMap hashmap capacity
      • Counter to track excess number of blocks

        Attachments

        1. 5897.rel20.patch
          20 kB
          Suresh Srinivas
        2. stats.1.patch
          21 kB
          Suresh Srinivas
        3. stats.patch
          21 kB
          Suresh Srinivas
        4. stats.patch
          21 kB
          Suresh Srinivas

          Activity

            People

            • Assignee:
              sureshms Suresh Srinivas
              Reporter:
              sureshms Suresh Srinivas
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: