[IMPALA-4661] Setting up HBase end-to-end tests does not work for remote clusters

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: Impala 2.7.0
• Fix Version/s: Not Applicable
• Component/s: Infrastructure
• Labels: hbase test test-infra
• Assignee: Unassigned
• Reporter: David Knupp
• Created: 14/Dec/16 20:38
• Updated: 24/Dec/20 01:16
• Resolved: 24/Dec/20 01:16

Description

When testing on our local dev environments, our HBase tests rely upon the fact that we presplit the data by running ./testdata/bin/split-hbase.sh during the data load phase. As-is, this script doesn't work against a remote cluster, and without it, remote cluster tests involving hbase will fail.

To make hbase tests run against a remote cluster, we need to either:

• Not rely on pre-splitting (although this has the problem of probably losing coverage, e.g. for testing HBase region pruning)
• Come up with a more reliable split method, or somehow synthesize the HBase metadata