[HBASE-23259] Ability to run mini cluster using pre-determined available random ports

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha-1, 1.4.12, 2.2.3
• Fix Version/s: 3.0.0-alpha-1, 2.3.0, 1.6.0
• Component/s: test
• Assignee: Bharath Vissapragada
• Reporter: Bharath Vissapragada
• Created: 06/Nov/19 02:33
• Updated: 22/Nov/19 11:59
• Resolved: 21/Nov/19 17:52

Description

As noted in the code reviews for HBASE-18095, we need the ability to run the mini-cluster using a pre-determined set of random (and available) port numbers. When I say pre-determined, I mean the test knows these ports even before starting the mini cluster.

In short, the workflow is something like,

List<Ports> ports = getRandomAvailablePorts();
startMiniCluster(conf, ports);

The reason we need this is that certain configs introduced in HBASE-18095 depend on the ports on which the master is expected to serve the RPCs. While that is known for regular deployments (like 16000 for master etc), it is totally random in the mini cluster tests. So we need to know them before hand for templating out the configs.

Issue Links

• blocks: HBASE-23305 Master based registry implementation
• is related to: HBASE-18095 Provide an option for clients to find the server hosting META that does not involve the ZooKeeper client
• links to: GitHub Pull Request #807
• links to: GitHub Pull Request #857
• links to: GitHub Pull Request #858