Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-12342

Rack Awareness : topology_script.py is not available on HMaster machine

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: None
    • Labels:
      None

      Description

      topology_script.py is not available on HMaster machine.

      HMaster Log:

      2015-06-24 01:34:06,080 INFO  [AM.ZK.Worker-pool2-t18] master.RegionStates: Transitioned {b6b08e515e7565b7743a2d8adae2769a state=PENDING_OPEN, ts=1435109645966, server=10.0.0.130,60020,1435108494187} to {b6b08e515e7565b7743a2d8adae2769a state=OPENING, ts=1435109646080, server=10.0.0.130,60020,1435108494187}
      2015-06-24 01:34:06,128 INFO  [AM.ZK.Worker-pool2-t19] master.RegionStates: Transitioned {a559ab8d632b831afbb66f5fb4cae0c9 state=PENDING_OPEN, ts=1435109645986, server=10.0.0.99,60020,1435108469160} to {a559ab8d632b831afbb66f5fb4cae0c9 state=OPENING, ts=1435109646128, server=10.0.0.99,60020,1435108469160}
      2015-06-24 01:34:06,128 INFO  [AM.ZK.Worker-pool2-t20] master.RegionStates: Transitioned {cadbf8d1d5b2147afc77a86fd53b40c0 state=PENDING_OPEN, ts=1435109645966, server=10.0.0.130,60020,1435108494187} to {cadbf8d1d5b2147afc77a86fd53b40c0 state=OPENING, ts=1435109646128, server=10.0.0.130,60020,1435108494187}
      2015-06-24 01:34:06,149 INFO  [AM.ZK.Worker-pool2-t21] master.RegionStates: Transitioned {bc9991635032c49cd248e3d5948dcc93 state=PENDING_OPEN, ts=1435109645948, server=10.0.0.14,60020,1435108940989} to {bc9991635032c49cd248e3d5948dcc93 state=OPENING, ts=1435109646149, server=10.0.0.14,60020,1435108940989}
      2015-06-24 01:34:06,663 INFO  [AM.ZK.Worker-pool2-t22] master.RegionStates: Transitioned {a559ab8d632b831afbb66f5fb4cae0c9 state=OPENING, ts=1435109646128, server=10.0.0.99,60020,1435108469160} to {a559ab8d632b831afbb66f5fb4cae0c9 state=OPEN, ts=1435109646663, server=10.0.0.99,60020,1435108469160}
      2015-06-24 01:34:06,693 INFO  [AM.ZK.Worker-pool2-t23] master.RegionStates: Transitioned {bc9991635032c49cd248e3d5948dcc93 state=OPENING, ts=1435109646149, server=10.0.0.14,60020,1435108940989} to {bc9991635032c49cd248e3d5948dcc93 state=OPEN, ts=1435109646693, server=10.0.0.14,60020,1435108940989}
      2015-06-24 01:34:06,694 INFO  [AM.ZK.Worker-pool2-t25] master.RegionStates: Onlined a559ab8d632b831afbb66f5fb4cae0c9 on 10.0.0.99,60020,1435108469160
      2015-06-24 01:34:06,725 INFO  [AM.ZK.Worker-pool2-t27] master.RegionStates: Onlined bc9991635032c49cd248e3d5948dcc93 on 10.0.0.14,60020,1435108940989
      2015-06-24 01:34:07,553 INFO  [AM.ZK.Worker-pool2-t28] master.RegionStates: Transitioned {b6b08e515e7565b7743a2d8adae2769a state=OPENING, ts=1435109646080, server=10.0.0.130,60020,1435108494187} to {b6b08e515e7565b7743a2d8adae2769a state=CLOSED, ts=1435109647553, server=10.0.0.130,60020,1435108494187}
      2015-06-24 01:34:07,555 WARN  [AM.ZK.Worker-pool2-t28] net.ScriptBasedMapping: Exception running /etc/hadoop/conf/topology_script.py 10.0.0.134 
      java.io.IOException: Cannot run program "/etc/hadoop/conf/topology_script.py" (in directory "/run/hbase"): error=2, No such file or directory
      	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
      	at org.apache.hadoop.util.Shell.runCommand(Shell.java:485)
      	at org.apache.hadoop.util.Shell.run(Shell.java:455)
      	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
      	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand(ScriptBasedMapping.java:251)
      	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.resolve(ScriptBasedMapping.java:188)
      	at org.apache.hadoop.net.CachedDNSToSwitchMapping.resolve(CachedDNSToSwitchMapping.java:119)
      	at org.apache.hadoop.hbase.master.RackManager.getRack(RackManager.java:66)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer$Cluster.<init>(BaseLoadBalancer.java:184)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.createCluster(BaseLoadBalancer.java:966)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.randomAssignment(BaseLoadBalancer.java:1010)
      	at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:2262)
      	at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:951)
      	at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1379)
      	at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1181)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.io.IOException: error=2, No such file or directory
      	at java.lang.UNIXProcess.forkAndExec(Native Method)
      	at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
      	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
      	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
      	... 19 more
      2015-06-24 01:34:07,557 WARN  [AM.ZK.Worker-pool2-t28] net.ScriptBasedMapping: Exception running /etc/hadoop/conf/topology_script.py 10.0.0.99 
      java.io.IOException: Cannot run program "/etc/hadoop/conf/topology_script.py" (in directory "/run/hbase"): error=2, No such file or directory
      	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
      	at org.apache.hadoop.util.Shell.runCommand(Shell.java:485)
      	at org.apache.hadoop.util.Shell.run(Shell.java:455)
      	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
      	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand(ScriptBasedMapping.java:251)
      	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.resolve(ScriptBasedMapping.java:188)
      	at org.apache.hadoop.net.CachedDNSToSwitchMapping.resolve(CachedDNSToSwitchMapping.java:119)
      	at org.apache.hadoop.hbase.master.RackManager.getRack(RackManager.java:66)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer$Cluster.<init>(BaseLoadBalancer.java:184)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.createCluster(BaseLoadBalancer.java:966)
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.randomAssignment(BaseLoadBalancer.java:1010)
      	at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:2262)
      	at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:951)
      	at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1379)
      	at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1181)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.io.IOException: error=2, No such file or directory
      	at java.lang.UNIXProcess.forkAndExec(Native Method)
      	at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
      	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
      	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
      	... 19 more
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tbeerbower Tom Beerbower
                Reporter:
                tbeerbower Tom Beerbower
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: