[HBASE-12721] Create Docker container cluster infrastructure to enable better testing

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: build, community, documentation, test

Release Note

Downstream users wishing to test HBase in a "distributed" fashion (multiple "nodes" running as separate containers on the same host) can now do so in an automated fashion while leveraging Docker for process isolation via the clusterdock project.

For details see the README.md in the dev-support/apache_hbase_topology folder.

• Assignee: Dima Spivak
• Reporter: Dima Spivak
• Created: 18/Dec/14 18:10
• Updated: 17/Jun/22 18:45
• Resolved: 17/Aug/16 20:27

Description

Some simple work on using HBase with Docker was committed into /dev-support as "hbase_docker;" all this did was stand up a standalone cluster from source and start a shell. Now seems like a good time to extend this to be useful for applications that could actual benefit the community, especially around testing. Some ideas:

• Integration testing would be much more accessible if people could stand up distributed HBase clusters on a single host machine in a couple minutes and run our awesome hbase-it suite against it.
• Binary compatibility testing of an HBase client is easiest when standing up an HBase cluster can be done once and then different client source/binary permutations run against it.
• Upgrade testing, and especially rolling upgrade testing, doesn't have any upstream automation on build.apache.org, in part because it's a pain to set up x-node clusters on Apache infrastructure.

This proposal, whether it stays under /dev-support or moves out into it's own top-level module ("hbase-docker" would conveniently fit the existing schema ), strives to create a simple framework for deploying "distributed," multi-container Apache HBase clusters.

Issue Links

• relates to: HADOOP-13397 Add dockerfile for Hadoop
• links to: ReviewBoard

Sub-Tasks

• Sort out how to push to apache/ repositories on Docker Hub: Closed
• Create Jenkins automation to build clusterdock framework regularly: Closed