Whirr
  1. Whirr
  2. WHIRR-571

HadoopConfigurationBuilder assumes that a Hadoop cluster has both a namenode and a jobtracker

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.7.1
    • Fix Version/s: 0.7.2
    • Component/s: service/hadoop
    • Labels:
      None

      Description

      I removed hadoop-jobtracker and hadoop-tasktracker from whirr.instance-templates in hbase-ec2.properties.
      Then I got the following error when trying to start a cluster.

      Am I doing anything wrong by removing the tracker from instance templates?
      Or is this an issue or not?
      If it is not an issue, am I be able to start hbase without starting the jobtracker and tasktracker? What is the right way to do it?

      Authorizing firewall ingress to [us-east-1/i-98c4f0fc] on ports [50070] for [128.83.158.52/32]
      Authorizing firewall ingress to [us-east-1/i-98c4f0fc] on ports [8020, 8021] for [174.129.136.180/32]
      Unable to start the cluster. Terminating all nodes.
      java.util.NoSuchElementException
      at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:152)
      at com.google.common.collect.Iterators.getOnlyElement(Iterators.java:293)
      at com.google.common.collect.Iterables.getOnlyElement(Iterables.java:265)
      at org.apache.whirr.Cluster.getInstanceMatching(Cluster.java:171)
      at org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:135)
      at org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduce(HadoopConfigurationBuilder.java:71)
      at org.apache.whirr.service.hadoop.HadoopClusterActionHandler.createHadoopConfigFiles(HadoopClusterActionHandler.java:104)
      at org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:89)
      at org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
      at org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
      at org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
      at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
      at org.apache.whirr.cli.Main.run(Main.java:64)
      at org.apache.whirr.cli.Main.main(Main.java:97)
      Unable to load cluster state, assuming it has no running nodes.

      1. whirr.log
        16 kB
        Zuocheng Ren
      2. exalt-hbase-ec2.properties
        3 kB
        Zuocheng Ren

        Activity

        Zuocheng Ren created issue -
        Zuocheng Ren made changes -
        Field Original Value New Value
        Attachment exalt-hbase-ec2.properties [ 12520164 ]
        Zuocheng Ren made changes -
        Attachment whirr.log [ 12520166 ]
        Andrei Savu made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 0.7.2 [ 12320175 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Zuocheng Ren
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development