Description
Multiple views fail to initialize with below exception when accessing HDFS.
From the application log:
Cannot find uri with key to create KeyProvider
15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 15/10/30 16:39:53 INFO impl.NMClientAsyncImpl: Processing Event EventType: START_CONTAINER for Container container_e01_1446222705122_0001_01_000008 15/10/30 16:39:53 INFO impl.ContainerManagementProtocolProxy: Opening proxy : os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 15/10/30 16:39:53 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 9 for hbase on 172.22.93.94:8020 15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
HBASE_THRIFT and HBASE_MASTER
15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_THRIFT', id='container_e01_1446222705122_0001_01_000008', container=ContainerID=container_e01_1446222705122_0001_01_000008 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741828 resource=<memory:3072, vCores:1>, createTime=1446223193693, startTime=1446223193777, released=false, roleId=4, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed 15/10/30 16:40:43 INFO agent.AgentProviderService: Removing component status for label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT 15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Container Completion for containerID=container_e01_1446222705122_0001_01_000002, state=COMPLETE, exitStatus=0, diagnostics= 15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Unregistering component container_e01_1446222705122_0001_01_000008 15/10/30 16:40:43 INFO state.AppState: Failed container in role[1] : HBASE_MASTER 15/10/30 16:40:43 INFO state.AppState: Duration 50550 and startTimeThreshold 60 15/10/30 16:40:43 INFO state.AppState: Current count of failed role[1] HBASE_MASTER = 1 15/10/30 16:40:43 INFO state.RoleHistory: Finished container for node 1, released=false, shortlived=true 15/10/30 16:40:43 INFO state.AppState: Removing node ID container_e01_1446222705122_0001_01_000002 15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_MASTER', id='container_e01_1446222705122_0001_01_000002', container=ContainerID=container_e01_1446222705122_0001_01_000002 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741825 resource=<memory:3072, vCores:1>, createTime=1446223192797, startTime=1446223193381, released=false, roleId=1, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000002___HBASE_MASTER --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed
The fix in HDFS requires Ambari-views to upgrade their HDFS dependency version to Hadoop 2.7.1
Attachments
Attachments
Issue Links
- is related to
-
HDFS-7931 DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled
-
- Closed
-