Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1453

Release version of avro-tools compiled against hadoop2

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.7.6
    • None
    • java
    • None
    • CDH4.4.0

    Description

      When attempting to use avro-tools-1.7.6.jar against my CDH4.4.0 cluster I get this error:

      Feb 06, 2014 9:57:13 PM org.apache.hadoop.util.NativeCodeLoader <clinit>
      WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      Exception in thread "main" org.apache.hadoop.ipc.RemoteException: Server IPC version 7 cannot communicate with client version 4
              at org.apache.hadoop.ipc.Client.call(Client.java:1066)
              at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
              at com.sun.proxy.$Proxy6.getProtocolVersion(Unknown Source)
              at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
              at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
              at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:118)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:222)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:187)
              at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
              at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1328)
              at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:65)
              at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:244)
              at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
              at org.apache.avro.tool.Util.openFromFS(Util.java:88)
              at org.apache.avro.tool.Util.fileOrStdin(Util.java:60)
              at org.apache.avro.tool.ConcatTool.run(ConcatTool.java:69)
              at org.apache.avro.tool.Main.run(Main.java:84)
              at org.apache.avro.tool.Main.main(Main.java:73)
      

      I believe that the version released on maven is compiled against hadoop 1, and I'm running hadoop 2. Can we release a version that's compiled against hadoop2?

      https://search.maven.org/#artifactdetails%7Corg.apache.avro%7Cavro-tools%7C1.7.6%7Cjar

      Thanks!
      Andrew

      Attachments

        1. AVRO-1453.patch
          6 kB
          Doug Cutting

        Activity

          People

            Unassigned Unassigned
            aash Andrew Ash
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: