[IMPALA-8345] Add option to set up minicluster to use Hive 3

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.2.0
• Fix Version/s: Impala 3.3.0
• Component/s: Infrastructure
• Epic Color: ghx-label-6
• Assignee: Vihang Karajgaonkar
• Reporter: Vihang Karajgaonkar
• Created: 25/Mar/19 18:21
• Updated: 28/Mar/19 18:30
• Resolved: 28/Mar/19 18:30

Description

Hive 3.1.0 has been released and being used in production for a while. It would be a nice improvement for Impala to have ability to use Hive 3.1.0 Metastore so that we can potentially use newer features (eg. ACID).

As a first step, in order to make sure Impala can run against a 3.1 Metastore, we should enable our test infrastructure to use Hive 3 instead of CDH Hive 2.1.1. This can be implemented as a optional configuration flag which when set (either via environment variable or command arg) sets up Hive 3.1.0 binaries in the mini-cluster.