Hadoop Common
  1. Hadoop Common
  2. HADOOP-6945

Inclusion of Old Jackson-JSON Breaks tasks using Avro (or any task depending on Jackson JSON)

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HADOOP-6184 added the ability to serialize the Configuration to JSON. However its inclusion of jackson-1.0.1 means that any map-reduce task that depends (directly or indirectly) on Jackson, can only use Jackson 1.0.1 APIs. The 100% fix is to give the task's classpath priority over the core/common classpath (MAPREDUCE-1700/MAPREDUCE-1938) so that a job can use newer revisions of the library.

      For a nearer term fix, is it possible to upgrade the included Jackson library to a recent version (1.5.x+)? The APIs are backwards compatible. alernatively, its possible to eliminate the use of Jackson for this minor feature as the Configuration object could be serialized to JSON without a 3rd party library.

      An ancilliary issue is that the jackson.version referenced in ivy.xml is never specified in the source tree (ivy/libraries.properties).

        Issue Links

          Activity

          Greg Wittel created issue -
          Allen Wittenauer made changes -
          Field Original Value New Value
          Link This issue is related to HADOOP-7606 [ HADOOP-7606 ]
          Allen Wittenauer made changes -
          Link This issue is related to HADOOP-7470 [ HADOOP-7470 ]
          Allen Wittenauer made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Greg Wittel
            • Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development