Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0, 2.2.0, 2.1.1, 2.0.2
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      While working on the parent issue, looking at a heap from a Master tha was running ~650 servers and > 300k regions, I tripped over some silly items in the heap:

      1. Balancer has a regions x server matrix which takes up 18% of the Master heap according to jxray and 40% according to eclipse. Looks like the matrix should be regions x racks which would be much smaller (Issue came in with HBASE-18164 Fast locality computation in balancer -Added new LocalityCostFunction and LocalityCandidateGenerator ..). See

      2. Duplicate Strings make up ~5% of the Master heap. Of these, ServerName seems to be the font. Interesting is report that there 54k instances of ServerName in this heap though there are only 650 Servers. See

      3. ArrayDequeue initializes its internal elements array with 16 elements. We use this in a few places. In Procedures, of which there are many in this heap, we near never make use of this array. See

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stack stack
                Reporter:
                stack stack
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: