Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16636

Regions in Transition counts wrong (zero) in HMaster /jmx, prevents detecting Regions Stuck in Transition

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.1.2
    • None
    • UI
    • None
    • HDP 2.3.2

    Description

      I've discovered that the Region in Transition counts are wrong in the HMaster UI /jmx page.

      The /master-status page clearly shows 3 regions stuck in transition but the /jmx page I was monitoring reported 0 for ritCountOverThreshold.

      }, {
          "name" : "Hadoop:service=HBase,name=Master,sub=AssignmentManger",
          "modelerType" : "Master,sub=AssignmentManger",
          "tag.Context" : "master",
          ...
          "ritOldestAge" : 0,
          "ritCountOverThreshold" : 0,
          ...
          "ritCount" : 0,
      

      I have a nagios plugin I wrote which was checking this which I've since had to rewrite to parse the /master-status page instead (the code is in check_hbase_regions_stuck_in_transition.py at https://github.com/harisekhon/nagios-plugins).

      I'm attaching screenshots of both /master-status and /jmx to show the difference in the 2 pages on the HMaster.

      Attachments

        1. Regions_in_Transition_UI.png
          30 kB
          Hari Sekhon
        2. ritCountOverThreshold.png
          50 kB
          Hari Sekhon

        Issue Links

          Activity

            People

              Unassigned Unassigned
              harisekhon Hari Sekhon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: