Hama
  1. Hama
  2. HAMA-805

Problem initializing pipes in HamaStreaming

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.3
    • Component/s: pipes
    • Labels:
      None
    • Environment:

      python 3.2, hadoop2

      Description

      
      Hello all,
      
      I try to use Hama Streaming.
      I have successfully installed Hama (the Pi example works).
      I follow this tutorial:
      http://wiki.apache.org/hama/HamaStreaming
      
      When I try to run the distributed HelloWorld in the local
      configuration, I get the following error:
      
      $ bin/hama pipes -streaming true -bspTasks 3 -interpreter python3.2
      -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program
      /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP
      
      13/09/23 18:03:50 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:03:50 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:03:50 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:03:50 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
      13/09/23 18:03:50 INFO bsp.LocalBSPRunner: Setting up a new barrier for 3 tasks!
      13/09/23 18:03:50 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
      java.lang.NullPointerException
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
         at java.lang.Thread.run(Thread.java:662)
      [output cropped]
      
      When I turn to the pseudo-distributed mode, job fails too (after a
      minute of execution):
      
      13/09/23 18:46:34 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:46:34 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:34 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:46:34 INFO bsp.BSPJobClient: Running job: job_201309231846_0001
      13/09/23 18:47:40 INFO bsp.BSPJobClient: Job failed.
      
      Task log contains errors:
      
      13/09/23 18:46:37 INFO ipc.Server: Starting Socket Reader #1 for port 43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server Responder: starting
      13/09/23 18:46:37 INFO ipc.Server: IPC Server listener on 43475: starting
      13/09/23 18:46:37 INFO message.HadoopMessageManagerImpl:  BSPPeer
      address:localhost.localdomain port:43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server handler 0 on 43475: starting
      13/09/23 18:46:37 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:37 INFO sync.ZKSyncClient: Initializing ZK Sync Client
      13/09/23 18:46:37 INFO sync.ZooKeeperSyncClientImpl: Start connecting
      to Zookeeper! At localhost.localdomain/127.0.0.1:43475
      13/09/23 18:46:37 ERROR bsp.BSPTask: Error running bsp setup and bsp function.
      java.lang.NullPointerException
         at java.io.File.<init>(File.java:222)
         at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
         at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:257)
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
         at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
         at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
      [output cropped]
      
      I use the latest trunk version of Hama, Python 3.2.5 and Hadoop 2.0.0-cdh4.1.1.
      
      Please help me to figure out the problem.
      
      Thanks in advance,
      Roman
      
      1. HAMA-805.patch
        3 kB
        Martin Illecker

        Issue Links

          Activity

          Martin Illecker made changes -
          Link This issue incorporates HAMA-811 [ HAMA-811 ]
          Martin Illecker made changes -
          Component/s pipes [ 12321200 ]
          Edward J. Yoon made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Martin Illecker made changes -
          Attachment HAMA-805.patch [ 12605009 ]
          Martin Illecker made changes -
          Attachment HAMA-805.patch [ 12604792 ]
          Martin Illecker made changes -
          Attachment HAMA-805.patch [ 12604792 ]
          Martin Illecker made changes -
          Field Original Value New Value
          Assignee Edward J. Yoon [ udanax ] Martin Illecker [ bafu ]
          Edward J. Yoon created issue -

            People

            • Assignee:
              Martin Illecker
              Reporter:
              Edward J. Yoon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development