Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-17093

Ambari cluster installation with blueprint is failing when installing only Kafka + AMS +Zookeeper

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.2.2
    • 2.4.0
    • ambari-server
    • None

    Description

      PROBLEM:
      Cluster installation with blueprint and cluster creation template shown below fails.

      blueprint

      {
          "configurations": [
          {
              "cluster-env": {
                  "properties": {
                      "ignore_groupsusers_create": "true"
                  }
              }
          },
          {
              "zookeeper-env": {
                  "properties_attributes": {},
                  "properties": {
                      "zk_server_heapsize": "1024m",
                      "zk_user": "zookeeper",
                      "zk_pid_dir": "/var/run/zookeeper",
                      "content": "\nexport JAVA_HOME={{java64_home}}\nexport ZOOKEEPER_HOME={{zk_home}}\nexport ZOO_LOG_DIR={{zk_log_dir}}\nexport ZOOPIDFILE={{zk_pid_file}}\nexport SERVER_JVMFLAGS={{zk_server_heapsize}}\nexport JAVA=$JAVA_HOME/bin/java\nexport CLASSPATH=$CLASSPATH:/usr/share/zookeeper/*\n\n{% if security_enabled %}\nexport SERVER_JVMFLAGS=\"$SERVER_JVMFLAGS -Djava.security.auth.login.config={{zk_server_jaas_file}}\"\nexport CLIENT_JVMFLAGS=\"$CLIENT_JVMFLAGS -Djava.security.auth.login.config={{zk_client_jaas_file}}\"\n{% endif %}"
                  }
              }
          }
      ],
          "host_groups": [
          {
              "components": [
                  {
                      "name": "METRICS_MONITOR"
                  },
                  {
                      "name": "METRICS_COLLECTOR"
                  },
                  {
                      "name": "KAFKA_BROKER"
                  },
                  {
                      "name": "ZOOKEEPER_CLIENT"
                  },
                  {
                      "name": "ZOOKEEPER_SERVER"
                  }
              ],
              "configurations": [],
              "name": "host_group_1"
          },
          {
              "components": [
                  {
                      "name": "METRICS_MONITOR"
                  },
                  {
                      "name": "KAFKA_BROKER"
                  },
                  {
                      "name": "ZOOKEEPER_SERVER"
                  }
              ],
              "configurations": [],
              "name": "host_group_2",
              "cardinality": "1"
          },
          {
              "components": [
                  {
                      "name": "METRICS_MONITOR"
                  },
                  {
                      "name": "KAFKA_BROKER"
                  }
              ],
              "configurations": [],
              "name": "host_group_3",
              "cardinality": "1"
          }
      ],
          "Blueprints": {
          "blueprint_name": "bp1",
              "stack_name": "HDP",
              "stack_version": "2.4"
      	}
      }
      

      Cluster Creation Template

      {
        "blueprint" : "bp1",
        "default_password" : "123123",
        "host_groups" :[
          {
            "name" : "host_group_1", 
            "hosts" : [         
              {
                "fqdn" : "c6401.ambari.apache.org"
              }
            ]
          },
          {
            "name" : "host_group_2", 
            "hosts" : [         
              {
                "fqdn" : "c6402.ambari.apache.org"
              }
            ]
          },
          {
            "name" : "host_group_3", 
            "hosts" : [         
              {
                "fqdn" : "c6403.ambari.apache.org"
              }
            ]
          }
        ]
      }
      
      	
      1 May 2016 21:14:13,720 ERROR [pool-9-thread-1] TopologyManager:775 - TopologyManager.ConfigureClusterTask: An exception occurred while attempting to process cluster configs and set on cluster: 
      java.lang.IllegalArgumentException: Unable to update configuration property 'xasecure.audit.destination.hdfs.dir' with topology information. Component 'NAMENODE' is mapped to an invalid number of hosts '0'. 
      at org.apache.ambari.server.controller.internal.BlueprintConfigurationProcessor$SingleHostTopologyUpdater.updateForClusterCreate(BlueprintConfigurationProcessor.java:1292) 
      at org.apache.ambari.server.controller.internal.BlueprintConfigurationProcessor.doUpdateForClusterCreate(BlueprintConfigurationProcessor.java:257) 
      at org.apache.ambari.server.topology.ClusterConfigurationRequest.process(ClusterConfigurationRequest.java:139) 
      at org.apache.ambari.server.topology.TopologyManager$ConfigureClusterTask.call(TopologyManager.java:773) 
      at org.apache.ambari.server.topology.TopologyManager$ConfigureClusterTask.call(TopologyManager.java:747) 
      at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) 
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
      at java.lang.Thread.run(Thread.java:745) 
      31 May 2016 21:14:13,721 INFO [pool-2-thread-1] AsyncCallableService:111 - Exception during task execution: 
      java.util.concurrent.ExecutionException: java.lang.Exception: java.lang.IllegalArgumentException: Unable to update configuration property 'xasecure.audit.destination.hdfs.dir' with topology information. Component 'NAMENODE' is mapped to an invalid number of hosts '0'. 
      at java.util.concurrent.FutureTask.report(FutureTask.java:122) 
      at java.util.concurrent.FutureTask.get(FutureTask.java:206) 
      at org.apache.ambari.server.topology.AsyncCallableService.taskCompleted(AsyncCallableService.java:103) 
      at org.apache.ambari.server.topology.AsyncCallableService.call(AsyncCallableService.java:74) 
      at org.apache.ambari.server.topology.AsyncCallableService.call(AsyncCallableService.java:37) 
      at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
      at java.lang.Thread.run(Thread.java:745) 
      Caused by: java.lang.Exception: java.lang.IllegalArgumentException: Unable to update configuration property 'xasecure.audit.destination.hdfs.dir' with topology information. Component 'NAMENODE' is mapped to an invalid number of hosts '0'. 
      at org.apache.ambari.server.topology.TopologyManager$ConfigureClusterTask.call(TopologyManager.java:779) 
      at org.apache.ambari.server.topology.TopologyManager$ConfigureClusterTask.call(TopologyManager.java:747) 
      at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) 
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 
      ... 3 more 
      Caused by: java.lang.IllegalArgumentException: Unable to update configuration property 'xasecure.audit.destination.hdfs.dir' with topology information. Component 'NAMENODE' is mapped to an invalid number of hosts '0'. 
      at org.apache.ambari.server.controller.internal.BlueprintConfigurationProcessor$SingleHostTopologyUpdater.updateForClusterCreate(BlueprintConfigurationProcessor.java:1292) 
      at org.apache.ambari.server.controller.internal.BlueprintConfigurationProcessor.doUpdateForClusterCreate(BlueprintConfigurationProcessor.java:257) 
      at org.apache.ambari.server.topology.ClusterConfigurationRequest.process(ClusterConfigurationRequest.java:139) 
      at org.apache.ambari.server.topology.TopologyManager$ConfigureClusterTask.call(TopologyManager.java:773) 
      ... 7 more
      

      Attachments

        1. AMBARI-17093.patch
          5 kB
          Magyari Sandor Szilard

        Activity

          People

            smagyari Magyari Sandor Szilard
            smagyari Magyari Sandor Szilard
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: