Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-198

running Giraph trunk on Hadoop 2.0.0-alpha leads to an exception

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.0.0
    • Component/s: mapreduce
    • Labels:
      None

      Description

      Here's how we compile:

      $ mvn -Phadoop_trunk -DskipTests -Dhadoop.version=2.0.0-alpha site package
      

      Here's how we run:

      $ export GIRAPH_HOME=/usr/lib/giraph 
      $ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -V 100000 -w 3
      

      Here's what we get in the task logs (as a side note – once 3 of the 8 tasks fail that way the entire job hangs forever which could be a bug in and of itself):

      2012-05-31 10:31:28,518 WARN [main]
      org.apache.hadoop.mapred.YarnChild: Exception running child :
      java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
             at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:170)
             at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.(WritableRpcEngine.java:110)
             at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:224)
             at $Proxy11.putVertexList(Unknown Source)
             at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:921)
             at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:322)
             at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:594)
             at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:473)
             at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
             at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
             at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
             at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
             at java.security.AccessController.doPrivileged(Native Method)
             at javax.security.auth.Subject.doAs(Subject.java:396)
             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
             at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
      Caused by: java.lang.NoSuchFieldException: versionID
             at java.lang.Class.getField(Class.java:1520)
             at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:166)
             ... 15 more
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ekoontz Eugene Koontz
                Reporter:
                rvs Roman Shaposhnik
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: