[IMPALA-1995] Flaky test: PlannerTest.testHbase: splits for HBASE KEYRANGE not set up correctly.

• Type: Task
• Status: Reopened
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: Impala 2.3.0, Impala 3.2.0
• Fix Version/s: Impala 2.13.0, Impala 3.1.0
• Component/s: Frontend
• Labels: broken-build flaky test-infra
• Target Version: Product Backlog
• Assignee: Joe McDonnell
• Reporter: Alexander Behm
• Created: 13/May/15 01:25
• Updated: 12/Oct/22 17:59

Description

Looks like testdata/bin/split-hbase.sh does not always set up the ranges in the way we want. See failure below.

Example run:
http://sandbox.jenkins.cloudera.com/job/impala-master-cdh5-trunk/1090/

Stack Trace:
java.lang.AssertionError: section SCANRANGELOCATIONS of query:
select * from functional_hbase.alltypessmall
where id < 5
actual result doesn't match expected result:
  HBASE KEYRANGE port=16202 3:7
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE port=16203 7:<unbounded>
  HBASE KEYRANGE port=16203 <unbounded>:3
NODE 0:

expected:
  HBASE KEYRANGE port=16201 <unbounded>:3
  HBASE KEYRANGE port=16202 3:7
  HBASE KEYRANGE port=16203 7:<unbounded>
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id < '5'
and tinyint_col = 5
actual result doesn't match expected result:
  HBASE KEYRANGE port=16201 1:3
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE port=16202 3:5
  HBASE KEYRANGE port=16203 <unbounded>:1
NODE 0:

expected:
  HBASE KEYRANGE port=16201 <unbounded>:3
  HBASE KEYRANGE port=16202 3:5
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.alltypesagg
where bigint_col is not null and bool_col = true
actual result doesn't match expected result:
  HBASE KEYRANGE port=16201 1:3
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE port=16202 3:7
  HBASE KEYRANGE port=16203 7:<unbounded>
  HBASE KEYRANGE port=16203 <unbounded>:1
NODE 0:

expected:
  HBASE KEYRANGE port=16201 <unbounded>:3
  HBASE KEYRANGE port=16202 3:7
  HBASE KEYRANGE port=16203 7:<unbounded>
NODE 0:

Issue Links

• duplicates: IMPALA-7061 PlannerTests should assign HBase splits as part of the test
• duplicates: IMPALA-9353 org.apache.impala.planner.PlannerTest.testHbaseNoKeyEstimate seems flaky after IMPALA-9349
• is duplicated by: IMPALA-9161 PlannerTest.testHbaseNoKeyEstimate failing
• is duplicated by: IMPALA-9553 Test flaky with HBase: PlannerTest.testResourceRequirements
• is duplicated by: IMPALA-11652 In org.apache.impala.planner.PlannerTest.testHbase, the selected range does not match the expected
• is related to: IMPALA-9161 PlannerTest.testHbaseNoKeyEstimate failing
• is related to: IMPALA-7061 PlannerTests should assign HBase splits as part of the test
• is related to: IMPALA-6350 split-hbase.sh failed during data load for exhaustive test run
• is related to: IMPALA-9553 Test flaky with HBase: PlannerTest.testResourceRequirements