[AMBARI-14138] Upgrade Ambari Views to Hadoop 2.7.1 jar which has the fix for HDFS-7931

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: contrib
• Assignee: Srimanth Gunturi
• Reporter: Srimanth Gunturi
• Created: 01/Dec/15 17:45
• Updated: 04/Dec/15 18:46
• Resolved: 02/Dec/15 01:48

Description

Multiple views fail to initialize with below exception when accessing HDFS.

From the application log:
Cannot find uri with key to create KeyProvider

15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
15/10/30 16:39:53 INFO impl.NMClientAsyncImpl: Processing Event EventType: START_CONTAINER for Container container_e01_1446222705122_0001_01_000008
15/10/30 16:39:53 INFO impl.ContainerManagementProtocolProxy: Opening proxy : os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454
15/10/30 16:39:53 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 9 for hbase on 172.22.93.94:8020
15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

HBASE_THRIFT and HBASE_MASTER

15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_THRIFT', id='container_e01_1446222705122_0001_01_000008', container=ContainerID=container_e01_1446222705122_0001_01_000008 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741828 resource=<memory:3072, vCores:1>, createTime=1446223193693, startTime=1446223193777, released=false, roleId=4, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed
15/10/30 16:40:43 INFO agent.AgentProviderService: Removing component status for label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT
15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Container Completion for containerID=container_e01_1446222705122_0001_01_000002, state=COMPLETE, exitStatus=0, diagnostics=
15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Unregistering component container_e01_1446222705122_0001_01_000008
15/10/30 16:40:43 INFO state.AppState: Failed container in role[1] : HBASE_MASTER
15/10/30 16:40:43 INFO state.AppState: Duration 50550 and startTimeThreshold 60
15/10/30 16:40:43 INFO state.AppState: Current count of failed role[1] HBASE_MASTER =  1
15/10/30 16:40:43 INFO state.RoleHistory: Finished container for node 1, released=false, shortlived=true
15/10/30 16:40:43 INFO state.AppState: Removing node ID container_e01_1446222705122_0001_01_000002
15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_MASTER', id='container_e01_1446222705122_0001_01_000002', container=ContainerID=container_e01_1446222705122_0001_01_000002 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741825 resource=<memory:3072, vCores:1>, createTime=1446223192797, startTime=1446223193381, released=false, roleId=1, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000002___HBASE_MASTER --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed

The fix in HDFS requires Ambari-views to upgrade their HDFS dependency version to Hadoop 2.7.1

Issue Links

• is related to: HDFS-7931 DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled