Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-805

Problem initializing pipes in HamaStreaming

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.6.3
    • pipes
    • None
    • python 3.2, hadoop2

    Description

      Hello all,
      
      I try to use Hama Streaming.
      I have successfully installed Hama (the Pi example works).
      I follow this tutorial:
      http://wiki.apache.org/hama/HamaStreaming
      
      When I try to run the distributed HelloWorld in the local
      configuration, I get the following error:
      
      $ bin/hama pipes -streaming true -bspTasks 3 -interpreter python3.2
      -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program
      /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP
      
      13/09/23 18:03:50 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:03:50 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:03:50 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:03:50 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
      13/09/23 18:03:50 INFO bsp.LocalBSPRunner: Setting up a new barrier for 3 tasks!
      13/09/23 18:03:50 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
      java.lang.NullPointerException
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
         at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
         at java.lang.Thread.run(Thread.java:662)
      [output cropped]
      
      When I turn to the pseudo-distributed mode, job fails too (after a
      minute of execution):
      
      13/09/23 18:46:34 INFO pipes.Submitter: Streaming enabled!
      13/09/23 18:46:34 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:34 WARN bsp.BSPJobClient: No job jar file set.  User
      classes may not be found. See BSPJob#setJar(String) or check Your jar
      file.
      13/09/23 18:46:34 INFO bsp.BSPJobClient: Running job: job_201309231846_0001
      13/09/23 18:47:40 INFO bsp.BSPJobClient: Job failed.
      
      Task log contains errors:
      
      13/09/23 18:46:37 INFO ipc.Server: Starting Socket Reader #1 for port 43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server Responder: starting
      13/09/23 18:46:37 INFO ipc.Server: IPC Server listener on 43475: starting
      13/09/23 18:46:37 INFO message.HadoopMessageManagerImpl:  BSPPeer
      address:localhost.localdomain port:43475
      13/09/23 18:46:37 INFO ipc.Server: IPC Server handler 0 on 43475: starting
      13/09/23 18:46:37 WARN util.NativeCodeLoader: Unable to load
      native-hadoop library for your platform... using builtin-java classes
      where applicable
      13/09/23 18:46:37 INFO sync.ZKSyncClient: Initializing ZK Sync Client
      13/09/23 18:46:37 INFO sync.ZooKeeperSyncClientImpl: Start connecting
      to Zookeeper! At localhost.localdomain/127.0.0.1:43475
      13/09/23 18:46:37 ERROR bsp.BSPTask: Error running bsp setup and bsp function.
      java.lang.NullPointerException
         at java.io.File.<init>(File.java:222)
         at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130)
         at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:257)
         at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44)
         at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
         at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
         at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
      [output cropped]
      
      I use the latest trunk version of Hama, Python 3.2.5 and Hadoop 2.0.0-cdh4.1.1.
      
      Please help me to figure out the problem.
      
      Thanks in advance,
      Roman
      

      Attachments

        1. HAMA-805.patch
          3 kB
          Martin Illecker

        Issue Links

          Activity

            People

              bafu Martin Illecker
              udanax Edward J. Yoon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: