[HIVE-11762] TestHCatLoaderEncryption failures when using Hadoop 2.7

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Shims, Tests
• Assignee: Jason Dere
• Reporter: Jason Dere
• Created: 08/Sep/15 20:10
• Updated: 16/Feb/16 23:53
• Resolved: 22/Sep/15 23:36

Description

When running TestHCatLoaderEncryption with -Dhadoop23.version=2.7.0, we get the following error during setup():

testReadDataFromEncryptedHiveTableByPig[5](org.apache.hive.hcatalog.pig.TestHCatLoaderEncryption)  Time elapsed: 3.648 sec  <<< ERROR!
java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.DFSClient.setKeyProvider(Lorg/apache/hadoop/crypto/key/KeyProviderCryptoExtension;)V
	at org.apache.hadoop.hive.shims.Hadoop23Shims.getMiniDfs(Hadoop23Shims.java:534)
	at org.apache.hive.hcatalog.pig.TestHCatLoaderEncryption.initEncryptionShim(TestHCatLoaderEncryption.java:252)
	at org.apache.hive.hcatalog.pig.TestHCatLoaderEncryption.setup(TestHCatLoaderEncryption.java:200)

It looks like between Hadoop 2.6 and Hadoop 2.7, the argument to DFSClient.setKeyProvider() changed:

   @VisibleForTesting
-  public void setKeyProvider(KeyProviderCryptoExtension provider) {
-    this.provider = provider;
+  public void setKeyProvider(KeyProvider provider) {