Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11755

Update avro version to have PowerPC supported Snappy-java

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None
    • Environment:

      PowerPC64, PowerPC64LE

      Description

      Hadoop downloads Snappy-java 1.0.4.1 version (which don't have PowerPC native libraries) through avro 1.7.4 dependency.
      Current Avro development version ( 1.8.0-SNAPSHOT) has updated the snappy-java version to 1.1.1.3 which has ppc64 & ppc64le native libraries.So Hadoop needs to update the avro version to the upcoming release ( probably 1.7.8) to have PowerPC supported snappy-java in its lib.

        Issue Links

          Activity

          Hide
          stevel@apache.org Steve Loughran added a comment -

          Linking to HADOOP-9991, the general "update JARs" JIRA.

          Upgrading dependencies is one of the key backwards compatibility troublespots: we don't want to ship old binaries, but we often have to for fear of breaking things downstream.

          There isn't going to be a rush to do this for Avro; it's not going to happen until after a release has been made and everyone is happy avro and snappy releases are not going to break things such as existing MR workloads.

          You are of course free to install later versions of avro (even unreleased ones) in your own installations

          Show
          stevel@apache.org Steve Loughran added a comment - Linking to HADOOP-9991 , the general "update JARs" JIRA. Upgrading dependencies is one of the key backwards compatibility troublespots: we don't want to ship old binaries, but we often have to for fear of breaking things downstream. There isn't going to be a rush to do this for Avro; it's not going to happen until after a release has been made and everyone is happy avro and snappy releases are not going to break things such as existing MR workloads. You are of course free to install later versions of avro (even unreleased ones) in your own installations

            People

            • Assignee:
              Unassigned
              Reporter:
              Ayappan Ayappan
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development