[HBASE-18175] Add hbase-spark integration test into hbase-spark-it

• Type: Test
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, connector-1.0.0
• Component/s: hbase-connectors, spark

Release Note

<!-- markdown -->
HBase now ships with an integration test for our integration with Apache Spark.

You can run this test on a cluster by using an equivalent to the below, e.g. if the version of HBase is 2.0.0-alpha-2

```
spark-submit --class org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad HBASE_HOME/lib/hbase-spark-it-2.0.0-alpha-2-tests.jar -Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic
```

• Assignee: Yi Liang
• Reporter: Yi Liang
• Created: 06/Jun/17 21:20
• Updated: 24/Jun/22 19:33
• Resolved: 14/Jul/17 19:53

Description

After HBASE-17574, all test under hbase-spark are regarded as unit test, and this jira will add integration test of hbase-spark into hbase-it. This patch run same tests as mapreduce.IntegrationTestBulkLoad, just change mapreduce to spark.

test in Maven:
mvn verify -Dit.test=IntegrationTestSparkBulkLoad

test on cluster:
spark-submit --class org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad HBASE_HOME/lib/hbase-it-2.0.0-SNAPSHOT-tests.jar -Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic

Issue Links

• blocks: HBASE-14160 backport hbase-spark module to branch-1 and branch-2
• is depended upon by: HBASE-14161 Add hbase-spark integration tests to IT jenkins job