Hama
  1. Hama
  2. HAMA-805

Problem initializing pipes in HamaStreaming

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.3
    • Component/s: pipes
    • Labels:
      None
    • Environment:

      python 3.2, hadoop2

      Description

      
      Hello all,
      
      I try to use Hama Streaming.
      I have successfully installed Hama (the Pi example works).
      I follow this tutorial:
      http://wiki.apache.org/hama/HamaStreaming
      
      When I try to run the distributed HelloWorld in the local
      configuration, I get the following error:
      
      $ bin/hama pipes -streaming true -bspTasks 3 -interpreter python3.2
      -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program
      /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP
      
      13/09/23 18:03:50 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:03:50 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:03:50 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:03:50 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
      13/09/23 18:03:50 INFO bsp.LocalBSPRunner: Setting up a new barrier for 3 tasks!
      13/09/23 18:03:50 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
      java.lang.NullPointerException
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
         at java.lang.Thread.run(Thread.java:662)
      [output cropped]
      
      When I turn to the pseudo-distributed mode, job fails too (after a
      minute of execution):
      
      13/09/23 18:46:34 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:46:34 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:34 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:46:34 INFO bsp.BSPJobClient: Running job: job_201309231846_0001
      13/09/23 18:47:40 INFO bsp.BSPJobClient: Job failed.
      
      Task log contains errors:
      
      13/09/23 18:46:37 INFO ipc.Server: Starting Socket Reader #1 for port 43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server Responder: starting
      13/09/23 18:46:37 INFO ipc.Server: IPC Server listener on 43475: starting
      13/09/23 18:46:37 INFO message.HadoopMessageManagerImpl:  BSPPeer
      address:localhost.localdomain port:43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server handler 0 on 43475: starting
      13/09/23 18:46:37 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:37 INFO sync.ZKSyncClient: Initializing ZK Sync Client
      13/09/23 18:46:37 INFO sync.ZooKeeperSyncClientImpl: Start connecting
      to Zookeeper! At localhost.localdomain/127.0.0.1:43475
      13/09/23 18:46:37 ERROR bsp.BSPTask: Error running bsp setup and bsp function.
      java.lang.NullPointerException
         at java.io.File.<init>(File.java:222)
         at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
         at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:257)
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
         at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
         at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
      [output cropped]
      
      I use the latest trunk version of Hama, Python 3.2.5 and Hadoop 2.0.0-cdh4.1.1.
      
      Please help me to figure out the problem.
      
      Thanks in advance,
      Roman
      
      1. HAMA-805.patch
        3 kB
        Martin Illecker

        Issue Links

          Activity

          Hide
          Martin Illecker added a comment -

          Please see HAMA-811.

          Show
          Martin Illecker added a comment - Please see HAMA-811 .
          Hide
          Martin Illecker added a comment -

          Sorry for the delay.
          HamaStreaming is still broken when running in local mode.

          Show
          Martin Illecker added a comment - Sorry for the delay. HamaStreaming is still broken when running in local mode.
          Hide
          Roman Shapovalov added a comment -

          Martin,

          Have you figured out that problem with the local mode?
          Is it still broken?

          Show
          Roman Shapovalov added a comment - Martin, Have you figured out that problem with the local mode? Is it still broken?
          Hide
          Martin Illecker added a comment -

          And Hama Streaming does not work when default file system (fs.default.name) is not set in hama-site.xml.

          13/09/27 10:16:17 DEBUG pipes.PipesApplication: DEBUG: DistributedCache.getLocalCacheFiles(conf) returns null.
          13/09/27 10:16:17 ERROR pipes.PipesApplication: Executable: null fs.default.name: file:///
          13/09/27 10:16:17 ERROR bsp.BSPTask: Error running bsp setup and bsp function.
          java.io.IOException: Executable is missing!
          	at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
          	at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260)
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
          	at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
          	at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
          13/09/27 10:16:17 ERROR bsp.BSPTask: Error cleaning up after bsp executed.
          java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86)
          	at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:183)
          	at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
          	at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
          13/09/27 10:16:17 INFO ipc.Server: Stopping server on 49671
          13/09/27 10:16:17 INFO ipc.Server: IPC Server handler 0 on 49671: exiting
          13/09/27 10:16:17 INFO ipc.Server: Stopping IPC Server listener on 49671
          13/09/27 10:16:17 ERROR bsp.BSPTask: Shutting down ping service.
          13/09/27 10:16:17 FATAL bsp.GroomServer: Error running child
          java.io.IOException: Executable is missing!
          	at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
          	at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260)
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
          	at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
          	at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
          java.io.IOException: Executable is missing!
          	at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
          	at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260)
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
          	at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
          	at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
          
          Show
          Martin Illecker added a comment - And Hama Streaming does not work when default file system (fs.default.name) is not set in hama-site.xml. 13/09/27 10:16:17 DEBUG pipes.PipesApplication: DEBUG: DistributedCache.getLocalCacheFiles(conf) returns null . 13/09/27 10:16:17 ERROR pipes.PipesApplication: Executable: null fs. default .name: file: /// 13/09/27 10:16:17 ERROR bsp.BSPTask: Error running bsp setup and bsp function. java.io.IOException: Executable is missing! at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130) at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260) at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176) at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246) 13/09/27 10:16:17 ERROR bsp.BSPTask: Error cleaning up after bsp executed. java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86) at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:183) at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246) 13/09/27 10:16:17 INFO ipc.Server: Stopping server on 49671 13/09/27 10:16:17 INFO ipc.Server: IPC Server handler 0 on 49671: exiting 13/09/27 10:16:17 INFO ipc.Server: Stopping IPC Server listener on 49671 13/09/27 10:16:17 ERROR bsp.BSPTask: Shutting down ping service. 13/09/27 10:16:17 FATAL bsp.GroomServer: Error running child java.io.IOException: Executable is missing! at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130) at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260) at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176) at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246) java.io.IOException: Executable is missing! at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130) at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:260) at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176) at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
          Hide
          Martin Illecker added a comment -

          Hama Streaming is not working in local mode!

          13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
          java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
          	at java.lang.Thread.run(Thread.java:680)
          13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Error cleaning up after bsp execution.
          java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:262)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
          	at java.lang.Thread.run(Thread.java:680)
          13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
          java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
          	at java.lang.Thread.run(Thread.java:680)
          13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Error cleaning up after bsp execution.
          java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:262)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
          	at java.lang.Thread.run(Thread.java:680)
          13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
          java.util.concurrent.ExecutionException: java.lang.NullPointerException
          	at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
          	at java.util.concurrent.FutureTask.get(FutureTask.java:83)
          	at org.apache.hama.bsp.LocalBSPRunner$ThreadObserver.run(LocalBSPRunner.java:313)
          	at java.lang.Thread.run(Thread.java:680)
          Caused by: java.lang.NullPointerException
          	at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
          	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
          	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
          	... 1 more
          13/09/27 09:38:25 INFO bsp.BSPJobClient: Job failed.
          Exception in thread "main" java.lang.IllegalArgumentException: not a proxy instance
          	at java.lang.reflect.Proxy.getInvocationHandler(Proxy.java:767)
          	at org.apache.hama.ipc.RPC.stopProxy(RPC.java:475)
          	at org.apache.hama.bsp.BSPJobClient.close(BSPJobClient.java:244)
          	at org.apache.hama.bsp.BSPJobClient.runJob(BSPJobClient.java:770)
          	at org.apache.hama.pipes.Submitter.runJob(Submitter.java:221)
          	at org.apache.hama.pipes.Submitter.run(Submitter.java:525)
          	at org.apache.hama.pipes.Submitter.main(Submitter.java:539)
          
          Show
          Martin Illecker added a comment - Hama Streaming is not working in local mode! 13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution! java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang. Thread .run( Thread .java:680) 13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Error cleaning up after bsp execution. java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:262) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang. Thread .run( Thread .java:680) 13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution! java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang. Thread .run( Thread .java:680) 13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Error cleaning up after bsp execution. java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.cleanup(PipesBSP.java:86) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:262) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang. Thread .run( Thread .java:680) 13/09/27 09:38:25 ERROR bsp.LocalBSPRunner: Exception during BSP execution! java.util.concurrent.ExecutionException: java.lang.NullPointerException at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) at java.util.concurrent.FutureTask.get(FutureTask.java:83) at org.apache.hama.bsp.LocalBSPRunner$ThreadObserver.run(LocalBSPRunner.java:313) at java.lang. Thread .run( Thread .java:680) Caused by: java.lang.NullPointerException at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) ... 1 more 13/09/27 09:38:25 INFO bsp.BSPJobClient: Job failed. Exception in thread "main" java.lang.IllegalArgumentException: not a proxy instance at java.lang.reflect.Proxy.getInvocationHandler(Proxy.java:767) at org.apache.hama.ipc.RPC.stopProxy(RPC.java:475) at org.apache.hama.bsp.BSPJobClient.close(BSPJobClient.java:244) at org.apache.hama.bsp.BSPJobClient.runJob(BSPJobClient.java:770) at org.apache.hama.pipes.Submitter.runJob(Submitter.java:221) at org.apache.hama.pipes.Submitter.run(Submitter.java:525) at org.apache.hama.pipes.Submitter.main(Submitter.java:539)
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #1047 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/1047/)
          HAMA-805: Problem initializing pipes in HamaStreaming (millecker: rev 1526259)

          • /hama/trunk/CHANGES.txt
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #1047 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/1047/ ) HAMA-805 : Problem initializing pipes in HamaStreaming (millecker: rev 1526259) /hama/trunk/CHANGES.txt /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hama-Nightly-for-Hadoop-2.x #44 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/44/)
          HAMA-805: Problem initializing pipes in HamaStreaming (millecker: rev 1526259)

          • /hama/trunk/CHANGES.txt
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Hama-Nightly-for-Hadoop-2.x #44 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/44/ ) HAMA-805 : Problem initializing pipes in HamaStreaming (millecker: rev 1526259) /hama/trunk/CHANGES.txt /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Hide
          Edward J. Yoon added a comment -

          Solved.

          Show
          Edward J. Yoon added a comment - Solved.
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hama-trunk #180 (See https://builds.apache.org/job/Hama-trunk/180/)
          HAMA-805: Problem initializing pipes in HamaStreaming (millecker: rev 1526259)

          • /hama/trunk/CHANGES.txt
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java
          • /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Show
          Hudson added a comment - FAILURE: Integrated in Hama-trunk #180 (See https://builds.apache.org/job/Hama-trunk/180/ ) HAMA-805 : Problem initializing pipes in HamaStreaming (millecker: rev 1526259) /hama/trunk/CHANGES.txt /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java
          Hide
          Edward J. Yoon added a comment -

          Great! +1

          Test passed on both hadoop1 and hadoop2.

          Show
          Edward J. Yoon added a comment - Great! +1 Test passed on both hadoop1 and hadoop2.
          Hide
          Martin Illecker added a comment -

          Please apply patch and Streaming should work.

          Show
          Martin Illecker added a comment - Please apply patch and Streaming should work.
          Hide
          Edward J. Yoon added a comment -

          Job hangs! :/

          edward@udanax:~/workspace/hama-trunk$ bin/hama jar examples/target/hama-examples-0.6.3-SNAPSHOT.jar pi
          13/09/25 22:39:54 INFO bsp.BSPJobClient: Running job: job_201309252239_0001
          13/09/25 22:39:57 INFO bsp.BSPJobClient: Current supersteps number: 1
          13/09/25 22:39:57 INFO bsp.BSPJobClient: The total number of supersteps: 1
          13/09/25 22:39:57 INFO bsp.BSPJobClient: Counters: 6
          13/09/25 22:39:57 INFO bsp.BSPJobClient:   org.apache.hama.bsp.JobInProgress$JobCounter
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     SUPERSTEPS=1
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=3
          13/09/25 22:39:57 INFO bsp.BSPJobClient:   org.apache.hama.bsp.BSPPeerImpl$PeerCounter
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=3
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=195
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_SENT=3
          13/09/25 22:39:57 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_RECEIVED=3
          Estimated value of PI is	3.1531999999999996
          Job Finished in 3.509 seconds
          edward@udanax:~/workspace/hama-trunk$ bin/hama pipes -streaming true -bspTasks 2 -interpreter python3 -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP
          13/09/25 22:40:02 INFO pipes.Submitter: Streaming enabled!
          13/09/25 22:40:02 WARN bsp.BSPJobClient: No job jar file set.  User classes may not be found. See BSPJob#setJar(String) or check Your jar file.
          13/09/25 22:40:03 INFO bsp.BSPJobClient: Running job: job_201309252239_0002
          
          Show
          Edward J. Yoon added a comment - Job hangs! :/ edward@udanax:~/workspace/hama-trunk$ bin/hama jar examples/target/hama-examples-0.6.3-SNAPSHOT.jar pi 13/09/25 22:39:54 INFO bsp.BSPJobClient: Running job: job_201309252239_0001 13/09/25 22:39:57 INFO bsp.BSPJobClient: Current supersteps number: 1 13/09/25 22:39:57 INFO bsp.BSPJobClient: The total number of supersteps: 1 13/09/25 22:39:57 INFO bsp.BSPJobClient: Counters: 6 13/09/25 22:39:57 INFO bsp.BSPJobClient: org.apache.hama.bsp.JobInProgress$JobCounter 13/09/25 22:39:57 INFO bsp.BSPJobClient: SUPERSTEPS=1 13/09/25 22:39:57 INFO bsp.BSPJobClient: LAUNCHED_TASKS=3 13/09/25 22:39:57 INFO bsp.BSPJobClient: org.apache.hama.bsp.BSPPeerImpl$PeerCounter 13/09/25 22:39:57 INFO bsp.BSPJobClient: SUPERSTEP_SUM=3 13/09/25 22:39:57 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=195 13/09/25 22:39:57 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=3 13/09/25 22:39:57 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=3 Estimated value of PI is 3.1531999999999996 Job Finished in 3.509 seconds edward@udanax:~/workspace/hama-trunk$ bin/hama pipes -streaming true -bspTasks 2 -interpreter python3 -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP 13/09/25 22:40:02 INFO pipes.Submitter: Streaming enabled! 13/09/25 22:40:02 WARN bsp.BSPJobClient: No job jar file set. User classes may not be found. See BSPJob#setJar( String ) or check Your jar file. 13/09/25 22:40:03 INFO bsp.BSPJobClient: Running job: job_201309252239_0002
          Hide
          Edward J. Yoon added a comment -

          I can test with hadoop2, today or tomorrow.

          Show
          Edward J. Yoon added a comment - I can test with hadoop2, today or tomorrow.
          Hide
          Martin Illecker added a comment -

          Please verify my patch.

          Problem: The default Hama Pipes UplinkReader was used, instead of StreamingUplinkReaderThread!

          Solution: The StreamingUplinkReaderThread overrides the default UplinkReader in StreamingProtocol.

          I also made a minor update [1] to the Streaming API, but that's not connected to this issue.

          The updated version can be found here [2]:

          git clone git://github.com/millecker/HamaStreaming.git
          

          Maybe we should include Hama Streaming into the trunk? (Subfolder of pipes module)

          [1] https://github.com/millecker/HamaStreaming/commit/1009bb1a6472d11f5dd3af9dc07fe64547dd0290
          [2] https://github.com/millecker/HamaStreaming

          Show
          Martin Illecker added a comment - Please verify my patch. Problem: The default Hama Pipes UplinkReader was used, instead of StreamingUplinkReaderThread! Solution: The StreamingUplinkReaderThread overrides the default UplinkReader in StreamingProtocol. I also made a minor update [1] to the Streaming API, but that's not connected to this issue. The updated version can be found here [2] : git clone git: //github.com/millecker/HamaStreaming.git Maybe we should include Hama Streaming into the trunk? (Subfolder of pipes module) [1] https://github.com/millecker/HamaStreaming/commit/1009bb1a6472d11f5dd3af9dc07fe64547dd0290 [2] https://github.com/millecker/HamaStreaming
          Hide
          Edward J. Yoon added a comment -

          Thanks Martin.

          Show
          Edward J. Yoon added a comment - Thanks Martin.
          Hide
          Martin Illecker added a comment -

          I don't think it's a HDFS's distcache problem.

          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG hama.pipes.logging: false
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFilesCount: 9
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSP.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPPeer.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BinaryProtocol.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BspJobConfiguration.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/HelloWorldBSP.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/KMeansBSP.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG: executable: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: File: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001 created!
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: STDOUT: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.log
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: STDERR: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.err
          13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG: cmd: [bash, -c, 'python3.2' '/tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py' 'HelloWorldBSP'  2>&1 | tee /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.log]
          

          Hama Streaming was developed by Thomas Jungblut nearly a year ago and I believe the Streaming API is not up to date.

          13/09/24 11:30:44 ERROR protocol.UplinkReader: java.io.IOException: Bad command code: 98
          	at org.apache.hama.pipes.protocol.UplinkReader.run(UplinkReader.java:173)
          

          I will have a look.

          Show
          Martin Illecker added a comment - I don't think it's a HDFS's distcache problem. 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG hama.pipes.logging: false 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFilesCount: 9 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSP.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPPeer.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BinaryProtocol.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BspJobConfiguration.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/HelloWorldBSP.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG LocalCacheFiles: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/KMeansBSP.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG: executable: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py 13/09/24 11:30:44 DEBUG pipes.PipesApplication: File: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001 created! 13/09/24 11:30:44 DEBUG pipes.PipesApplication: STDOUT: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.log 13/09/24 11:30:44 DEBUG pipes.PipesApplication: STDERR: /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.err 13/09/24 11:30:44 DEBUG pipes.PipesApplication: DEBUG: cmd: [bash, -c, 'python3.2' '/tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/BSPRunner.py' 'HelloWorldBSP' 2>&1 | tee /tmp/hadoop-martin/bsp/local/groomServer/attempt_201309241128_0001_000000_0/work/tasklogs/job_201309241128_0001/attempt_201309241128_0001_000000_0.log] Hama Streaming was developed by Thomas Jungblut nearly a year ago and I believe the Streaming API is not up to date. 13/09/24 11:30:44 ERROR protocol.UplinkReader: java.io.IOException: Bad command code: 98 at org.apache.hama.pipes.protocol.UplinkReader.run(UplinkReader.java:173) I will have a look.
          Hide
          Edward J. Yoon added a comment -

          I guess this problem is related with HDFS's distcache APIs.

          Show
          Edward J. Yoon added a comment - I guess this problem is related with HDFS's distcache APIs.

            People

            • Assignee:
              Martin Illecker
              Reporter:
              Edward J. Yoon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development