Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5693

Few NN metrics data points were collected via JMX when NN is under heavy load

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • namenode
    • None
    • Reviewed

    Description

      JMX sometimes doesn’t return any value when NN is under heavy load. However, that is when we would like to get metrics to help to diagnosis the issue.

      When NN is under heavy load due to bad application or other reasons, it holds FSNamesystem's writer lock for a long period of time. Many of the FSNamesystem metrics require FSNamesystem's reader lock and thus can't be processed.

      This is a special case to improve the overall NN concurrency.

      Attachments

        1. HADOOP-5693.patch
          13 kB
          Ming Ma
        2. HDFS-5693.patch
          13 kB
          Ming Ma
        3. HDFS-5693-2.patch
          13 kB
          Ming Ma

        Activity

          People

            mingma Ming Ma
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: