[ACCUMULO-3083] capability balancing

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Abandoned
• Component/s: master
• Assignee: Unassigned
• Reporter: Eric C. Newton
• Created: 25/Aug/14 22:44
• Updated: 02/Nov/22 19:31
• Resolved: 02/Nov/22 19:31

Description

I was thinking about balancing, in much the way that new container-based (yarn, mesos, etc) resource managers work. The existing Balancers try to keep the number of tablets even over presumably homogeneous nodes.

But as clusters age and are improved and expanded in piecemeal, the hardware capabilities will drift apart. Some nodes may be capable of handling more load than others. We may even want some nodes to have a trivial number of tablets so the data they serve is always cached.

Tablet servers could advertise an attribute (or several). Really, it would just be a name, like fatnode or metaonly. These would then be used by the Balancer to favor or ignore tservers for balancing.

Issue Links

• is related to: HBASE-11780 Add a resource based load balancer
• relates to: ACCUMULO-2841 Arbitrary namespace and table metadata tags