[RANGER-1935] Upgrade Ranger to support Apache Hadoop 3.0.0

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: plugins
• Assignee: Colm O hEigeartaigh
• Reporter: Colm O hEigeartaigh
• Created: 18/Dec/17 14:56
• Updated: 12/Nov/19 16:04
• Resolved: 28/Feb/19 10:14

Description

This task is to upgrade Ranger to support Apache Hadoop 3.0.0. Here are some notes about the upgrade:

a) The Hive plugin needs the Hadoop 3.0.0 jars to run the tests properly, as Hive only supports the older Hadoop version, so an exclusion and some additional 3.0.0 dependencies need to be added.
b) The Storm plugin bundles the hadoop-auth jars in storm-core (although they really should be renamed here). Therefore, we have no option but to package Storm with the Hadoop 2.7.x jars, until such time that Storm upgrades the Hadoop dependency.

This is an initial patch to get some feedback. If there is broad agreement on the upgrade I will test the distributions properly.

Issue Links

• is related to: RANGER-1738 RangerYarnAuthorizer not compatible with Hadoop-3.0.0
• relates to: RANGER-1899 Add reencryptEncryptedKey interface to RangerKMS and improve logs
• relates to: RANGER-1738 RangerYarnAuthorizer not compatible with Hadoop-3.0.0
• relates to: RANGER-2148 Update Ranger Hive dependency version to 3.0
• links to: Review Request