Hadoop Common
  1. Hadoop Common
  2. HADOOP-5897

Add more Metrics to Namenode to capture heap usage

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: metrics
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recently we had GC issues, where Namenode used more heap than usual. There was no growth indicated by the data in current Metrics to justify the heap usage. Adding more stats such as:

      • Counter to track blocks that are pending deletion
      • BlocksMap hashmap capacity
      • Counter to track excess number of blocks
      1. stats.patch
        21 kB
        Suresh Srinivas
      2. stats.patch
        21 kB
        Suresh Srinivas
      3. stats.1.patch
        21 kB
        Suresh Srinivas
      4. 5897.rel20.patch
        20 kB
        Suresh Srinivas

        Activity

        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s dfs [ 12310710 ]
        Suresh Srinivas made changes -
        Attachment 5897.rel20.patch [ 12411942 ]
        Tsz Wo Nicholas Sze made changes -
        Component/s dfs [ 12310710 ]
        Component/s metrics [ 12310971 ]
        Konstantin Shvachko made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12313563 ]
        Resolution Fixed [ 1 ]
        Suresh Srinivas made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Suresh Srinivas made changes -
        Attachment stats.1.patch [ 12410190 ]
        Suresh Srinivas made changes -
        Attachment stats.patch [ 12409326 ]
        Suresh Srinivas made changes -
        Field Original Value New Value
        Attachment stats.patch [ 12409288 ]
        Suresh Srinivas created issue -

          People

          • Assignee:
            Suresh Srinivas
            Reporter:
            Suresh Srinivas
          • Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development