Uploaded image for project: 'Avro'
  1. Avro
  2. AVRO-1037

Problems using Avro 1.6.2 with Hadoop (CDH3 or 1.0)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.2
    • Fix Version/s: 1.6.3
    • Component/s: java
    • Labels:
      None

      Description

      AVRO-972 uses a method on JsonNode that was introduced with Jackson 1.6.0. Unfortunately, Hadoop in a distributed environment places jackson on the mapreduce classpath prior to a user's Jar.

      Avro should function when this happens.

      There are two things we are using that are new in Jackson 1.6.0 – JsonNode.getValueAsDouble() and MinimalPrettyPrinter

      MinimalPrettyPrinter is OK because the class is new, and if there is a Jackson 1.5.x jar on a classpath before one that is >= 1.6.0, it will find the class in the second jar. We need to avoid JsonNode.getValueAsDouble() however. There is a replacement that is equivalent and existed prior, JsonNode.getDoubleValue().

        Attachments

          Activity

            People

            • Assignee:
              scott_carey Scott Carey
              Reporter:
              scott_carey Scott Carey
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: