Uploaded image for project: 'Apache Whirr (retired)'
  1. Apache Whirr (retired)
  2. WHIRR-571

HadoopConfigurationBuilder assumes that a Hadoop cluster has both a namenode and a jobtracker

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 0.7.1
    • 0.7.2
    • service/hadoop
    • None

    Description

      I removed hadoop-jobtracker and hadoop-tasktracker from whirr.instance-templates in hbase-ec2.properties.
      Then I got the following error when trying to start a cluster.

      Am I doing anything wrong by removing the tracker from instance templates?
      Or is this an issue or not?
      If it is not an issue, am I be able to start hbase without starting the jobtracker and tasktracker? What is the right way to do it?

      Authorizing firewall ingress to [us-east-1/i-98c4f0fc] on ports [50070] for [128.83.158.52/32]
      Authorizing firewall ingress to [us-east-1/i-98c4f0fc] on ports [8020, 8021] for [174.129.136.180/32]
      Unable to start the cluster. Terminating all nodes.
      java.util.NoSuchElementException
      at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:152)
      at com.google.common.collect.Iterators.getOnlyElement(Iterators.java:293)
      at com.google.common.collect.Iterables.getOnlyElement(Iterables.java:265)
      at org.apache.whirr.Cluster.getInstanceMatching(Cluster.java:171)
      at org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:135)
      at org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduce(HadoopConfigurationBuilder.java:71)
      at org.apache.whirr.service.hadoop.HadoopClusterActionHandler.createHadoopConfigFiles(HadoopClusterActionHandler.java:104)
      at org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:89)
      at org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
      at org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
      at org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
      at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
      at org.apache.whirr.cli.Main.run(Main.java:64)
      at org.apache.whirr.cli.Main.main(Main.java:97)
      Unable to load cluster state, assuming it has no running nodes.

      Attachments

        1. whirr.log
          16 kB
          Zuocheng Ren
        2. exalt-hbase-ec2.properties
          3 kB
          Zuocheng Ren

        Activity

          People

            Unassigned Unassigned
            awakenrz Zuocheng Ren
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: