Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-14138

Upgrade Ambari Views to Hadoop 2.7.1 jar which has the fix for HDFS-7931

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.2.0
    • Component/s: contrib
    • Labels:
      None

      Description

      Multiple views fail to initialize with below exception when accessing HDFS.

      From the application log:
      Cannot find uri with key to create KeyProvider

      15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
      15/10/30 16:39:53 INFO impl.NMClientAsyncImpl: Processing Event EventType: START_CONTAINER for Container container_e01_1446222705122_0001_01_000008
      15/10/30 16:39:53 INFO impl.ContainerManagementProtocolProxy: Opening proxy : os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454
      15/10/30 16:39:53 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 9 for hbase on 172.22.93.94:8020
      15/10/30 16:39:53 ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
      

      HBASE_THRIFT and HBASE_MASTER

      15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_THRIFT', id='container_e01_1446222705122_0001_01_000008', container=ContainerID=container_e01_1446222705122_0001_01_000008 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741828 resource=<memory:3072, vCores:1>, createTime=1446223193693, startTime=1446223193777, released=false, roleId=4, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed
      15/10/30 16:40:43 INFO agent.AgentProviderService: Removing component status for label container_e01_1446222705122_0001_01_000008___HBASE_THRIFT
      15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Container Completion for containerID=container_e01_1446222705122_0001_01_000002, state=COMPLETE, exitStatus=0, diagnostics=
      15/10/30 16:40:43 INFO appmaster.SliderAppMaster: Unregistering component container_e01_1446222705122_0001_01_000008
      15/10/30 16:40:43 INFO state.AppState: Failed container in role[1] : HBASE_MASTER
      15/10/30 16:40:43 INFO state.AppState: Duration 50550 and startTimeThreshold 60
      15/10/30 16:40:43 INFO state.AppState: Current count of failed role[1] HBASE_MASTER =  1
      15/10/30 16:40:43 INFO state.RoleHistory: Finished container for node 1, released=false, shortlived=true
      15/10/30 16:40:43 INFO state.AppState: Removing node ID container_e01_1446222705122_0001_01_000002
      15/10/30 16:40:43 ERROR appmaster.SliderAppMaster: Role instance RoleInstance{role='HBASE_MASTER', id='container_e01_1446222705122_0001_01_000002', container=ContainerID=container_e01_1446222705122_0001_01_000002 nodeID=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:25454 http=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042 priority=1073741825 resource=<memory:3072, vCores:1>, createTime=1446223192797, startTime=1446223193381, released=false, roleId=1, host=os-r6-jhtlqs-hbase-slider-1-re-7.novalocal, hostURL=http://os-r6-jhtlqs-hbase-slider-1-re-7.novalocal:8042, state=5, placement=null, exitCode=0, command='python ./infra/agent/slider-agent/agent/main.py --label container_e01_1446222705122_0001_01_000002___HBASE_MASTER --zk-quorum os-r6-jhtlqs-hbase-slider-1-re-1.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-2.novalocal:2181,os-r6-jhtlqs-hbase-slider-1-re-3.novalocal:2181 --zk-reg-path /registry/users/hbase/services/org-apache-slider/hbasesliderapp > <LOG_DIR>/slider-agent.out 2>&1 ; ', diagnostics='', output=null, environment=[LANGUAGE="en_US.UTF-8", AGENT_WORK_ROOT="$PWD", AGENT_LOG_ROOT="<LOG_DIR>", PYTHONPATH="./infra/agent/slider-agent/", LC_ALL="en_US.UTF-8", SLIDER_PASSPHRASE="kNR1KYBtgRDN3aVHmnh8HVStB3XNwQwPPJ5kbo3xAG9y2h35hp", MALLOC_ARENA_MAX="4", LANG="en_US.UTF-8"]} failed
      

      The fix in HDFS requires Ambari-views to upgrade their HDFS dependency version to Hadoop 2.7.1

        Attachments

        1. AMBARI-14138_branch-2.1.patch
          14 kB
          Srimanth Gunturi
        2. AMBARI-14138.patch
          8 kB
          Srimanth Gunturi

          Issue Links

            Activity

              People

              • Assignee:
                srimanth.gunturi Srimanth Gunturi
                Reporter:
                srimanth.gunturi Srimanth Gunturi
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: