Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-21118

HDP + HDF cluster cannot save configs for Storm when Streamline is installed due to missing configs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.5.1
    • 2.5.2
    • stacks
    • None

    Description

      STR:

      • Install Ambari 2.5.1 with HDP 2.6.1 plus Storm and Streamline (from HDF MPack)
      • Attempt to change configs for Storm

      Ambari: 2.5.1.0-146
      HDF: 3.0.0.0-358
      HDP: 2.6.1.0-110

      This is happening because Storm does not have Streamline as a dependent service, so the UI does not pass the Streamline configs to the recommendations endpoint when calling Stack Advisor for Storm.

      '), ('yarn.scheduler.capacity.root.accessible-node-labels', '*'), ('yarn.scheduler.capacity.root.capacity', '100'), ('yarn.scheduler.capacity.maximum-am-resource-percent', '0.2'), ('yarn.scheduler.capacity.maximum-applications', '10000'), ('yarn.scheduler.capacity.root.de
      fault.user-limit-factor', '1'), ('yarn.scheduler.capacity.node-locality-delay', '40'), ('yarn.scheduler.capacity.root.default.acl_submit_applications', 'yarn'), ('yarn.scheduler.capacity.root.default.state', 'RUNNING'), ('yarn.scheduler.capacity.root.default.capacity', '1
      00'), ('yarn.scheduler.capacity.root.acl_administer_queue', 'yarn'), ('yarn.scheduler.capacity.root.default.maximum-capacity', '100'), ('yarn.scheduler.capacity.root.queues', 'default'), ('yarn.scheduler.capacity.root.acl_administer_jobs', 'yarn'), ('', ''), ('yarn.schedu
      ler.capacity.root.default.acl_administer_jobs', 'yarn'), ('yarn.scheduler.capacity.resource-calculator', 'org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator')]
      Error occured in stack advisor.
      Error details: argument of type 'NoneType' is not iterable
      24 May 2017 19:43:17,686  INFO [ambari-client-thread-31] StackAdvisorRunner:71 -     advisor script stderr: Traceback (most recent call last):
        File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 166, in <module>
          main(sys.argv)
        File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 116, in main
          result = stackAdvisor.recommendConfigurations(services, hosts)
        File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py", line 775, in recommendConfigurations
          calculation(configurations, clusterSummary, services, hosts)
        File "/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.6/services/stack_advisor.py", line 68, in recommendSTORMConfigurations
          _streamline_principal_name = streamline_env['streamline_principal_name'] if 'streamline_principal_name' in streamline_env else None
      TypeError: argument of type 'NoneType' is not iterable
      24 May 2017 19:43:17,686  WARN [ambari-client-thread-31] AbstractResourceProvider:97 - Error occured during recommendation
      org.apache.ambari.server.api.services.stackadvisor.StackAdvisorException: Stack Advisor reported an error: TypeError: argument of type 'NoneType' is not iterable
      StdOut file: /var/run/ambari-server/stack-recommendations/30/stackadvisor.out
      
      StdErr file: /var/run/ambari-server/stack-recommendations/30/stackadvisor.err
              at org.apache.ambari.server.api.services.stackadvisor.StackAdvisorRunner.runScript(StackAdvisorRunner.java:96)
              at org.apache.ambari.server.api.services.stackadvisor.commands.StackAdvisorCommand.invoke(StackAdvisorCommand.java:295)
              at org.apache.ambari.server.api.services.stackadvisor.StackAdvisorHelper.recommend(StackAdvisorHelper.java:113)
              at org.apache.ambari.server.controller.internal.RecommendationResourceProvider.createResources(RecommendationResourceProvider.java:92)
              at org.apache.ambari.server.controller.internal.ClusterControllerImpl.createResources(ClusterControllerImpl.java:298)
              at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.create(PersistenceManagerImpl.java:97)
              at org.apache.ambari.server.api.handlers.CreateHandler.persist(CreateHandler.java:37)
              at org.apache.ambari.server.api.handlers.BaseManagementHandler.handleRequest(BaseManagementHandler.java:73)
              at org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:144)
              at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:126)
              at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:90)
      

      Attachments

        1. AMBARI-21118.2.5-maint.patch
          3 kB
          Alejandro Fernandez

        Activity

          People

            afernandez Alejandro Fernandez
            afernandez Alejandro Fernandez
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: