[AMBARI-12342] Rack Awareness : topology_script.py is not available on HMaster machine

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Assignee: Tom Beerbower
• Reporter: Tom Beerbower
• Created: 08/Jul/15 21:03
• Updated: 08/Jul/15 23:21
• Resolved: 08/Jul/15 21:27

Description

topology_script.py is not available on HMaster machine.

HMaster Log:

2015-06-24 01:34:06,080 INFO  [AM.ZK.Worker-pool2-t18] master.RegionStates: Transitioned {b6b08e515e7565b7743a2d8adae2769a state=PENDING_OPEN, ts=1435109645966, server=10.0.0.130,60020,1435108494187} to {b6b08e515e7565b7743a2d8adae2769a state=OPENING, ts=1435109646080, server=10.0.0.130,60020,1435108494187}
2015-06-24 01:34:06,128 INFO  [AM.ZK.Worker-pool2-t19] master.RegionStates: Transitioned {a559ab8d632b831afbb66f5fb4cae0c9 state=PENDING_OPEN, ts=1435109645986, server=10.0.0.99,60020,1435108469160} to {a559ab8d632b831afbb66f5fb4cae0c9 state=OPENING, ts=1435109646128, server=10.0.0.99,60020,1435108469160}
2015-06-24 01:34:06,128 INFO  [AM.ZK.Worker-pool2-t20] master.RegionStates: Transitioned {cadbf8d1d5b2147afc77a86fd53b40c0 state=PENDING_OPEN, ts=1435109645966, server=10.0.0.130,60020,1435108494187} to {cadbf8d1d5b2147afc77a86fd53b40c0 state=OPENING, ts=1435109646128, server=10.0.0.130,60020,1435108494187}
2015-06-24 01:34:06,149 INFO  [AM.ZK.Worker-pool2-t21] master.RegionStates: Transitioned {bc9991635032c49cd248e3d5948dcc93 state=PENDING_OPEN, ts=1435109645948, server=10.0.0.14,60020,1435108940989} to {bc9991635032c49cd248e3d5948dcc93 state=OPENING, ts=1435109646149, server=10.0.0.14,60020,1435108940989}
2015-06-24 01:34:06,663 INFO  [AM.ZK.Worker-pool2-t22] master.RegionStates: Transitioned {a559ab8d632b831afbb66f5fb4cae0c9 state=OPENING, ts=1435109646128, server=10.0.0.99,60020,1435108469160} to {a559ab8d632b831afbb66f5fb4cae0c9 state=OPEN, ts=1435109646663, server=10.0.0.99,60020,1435108469160}
2015-06-24 01:34:06,693 INFO  [AM.ZK.Worker-pool2-t23] master.RegionStates: Transitioned {bc9991635032c49cd248e3d5948dcc93 state=OPENING, ts=1435109646149, server=10.0.0.14,60020,1435108940989} to {bc9991635032c49cd248e3d5948dcc93 state=OPEN, ts=1435109646693, server=10.0.0.14,60020,1435108940989}
2015-06-24 01:34:06,694 INFO  [AM.ZK.Worker-pool2-t25] master.RegionStates: Onlined a559ab8d632b831afbb66f5fb4cae0c9 on 10.0.0.99,60020,1435108469160
2015-06-24 01:34:06,725 INFO  [AM.ZK.Worker-pool2-t27] master.RegionStates: Onlined bc9991635032c49cd248e3d5948dcc93 on 10.0.0.14,60020,1435108940989
2015-06-24 01:34:07,553 INFO  [AM.ZK.Worker-pool2-t28] master.RegionStates: Transitioned {b6b08e515e7565b7743a2d8adae2769a state=OPENING, ts=1435109646080, server=10.0.0.130,60020,1435108494187} to {b6b08e515e7565b7743a2d8adae2769a state=CLOSED, ts=1435109647553, server=10.0.0.130,60020,1435108494187}
2015-06-24 01:34:07,555 WARN  [AM.ZK.Worker-pool2-t28] net.ScriptBasedMapping: Exception running /etc/hadoop/conf/topology_script.py 10.0.0.134 
java.io.IOException: Cannot run program "/etc/hadoop/conf/topology_script.py" (in directory "/run/hbase"): error=2, No such file or directory
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:485)
	at org.apache.hadoop.util.Shell.run(Shell.java:455)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand(ScriptBasedMapping.java:251)
	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.resolve(ScriptBasedMapping.java:188)
	at org.apache.hadoop.net.CachedDNSToSwitchMapping.resolve(CachedDNSToSwitchMapping.java:119)
	at org.apache.hadoop.hbase.master.RackManager.getRack(RackManager.java:66)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer$Cluster.<init>(BaseLoadBalancer.java:184)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.createCluster(BaseLoadBalancer.java:966)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.randomAssignment(BaseLoadBalancer.java:1010)
	at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:2262)
	at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:951)
	at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1379)
	at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1181)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
	at java.lang.UNIXProcess.forkAndExec(Native Method)
	at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
	... 19 more
2015-06-24 01:34:07,557 WARN  [AM.ZK.Worker-pool2-t28] net.ScriptBasedMapping: Exception running /etc/hadoop/conf/topology_script.py 10.0.0.99 
java.io.IOException: Cannot run program "/etc/hadoop/conf/topology_script.py" (in directory "/run/hbase"): error=2, No such file or directory
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:485)
	at org.apache.hadoop.util.Shell.run(Shell.java:455)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.runResolveCommand(ScriptBasedMapping.java:251)
	at org.apache.hadoop.net.ScriptBasedMapping$RawScriptBasedMapping.resolve(ScriptBasedMapping.java:188)
	at org.apache.hadoop.net.CachedDNSToSwitchMapping.resolve(CachedDNSToSwitchMapping.java:119)
	at org.apache.hadoop.hbase.master.RackManager.getRack(RackManager.java:66)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer$Cluster.<init>(BaseLoadBalancer.java:184)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.createCluster(BaseLoadBalancer.java:966)
	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer.randomAssignment(BaseLoadBalancer.java:1010)
	at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:2262)
	at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:951)
	at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1379)
	at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1181)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
	at java.lang.UNIXProcess.forkAndExec(Native Method)
	at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
	... 19 more

Issue Links

• links to: Code review