Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1917

Clean up duplication of dependent jar files

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: build
    • Labels:
      None
    • Environment:

      Java 6, RHEL 5.5

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Remove packaging of duplicated third party jar files

      Description

      For trunk, the build and deployment tree look like this:

      hadoop-common-0.2x.y
      hadoop-hdfs-0.2x.y
      hadoop-mapred-0.2x.y

      Technically, hdfs's the third party dependent jar files should be fetch from hadoop-common. However, it is currently fetching from hadoop-hdfs/lib only. It would be nice to eliminate the need to repeat duplicated jar files at build time.

      There are two options to manage this dependency list, continue to enhance ant build structure to fetch and filter jar file dependencies using ivy. On the other hand, it would be a good opportunity to convert the build structure to maven, and use maven to manage the provided jar files.

      1. HDFS-1917-1.patch
        6 kB
        Eric Yang
      2. HDFS-1917.patch
        6 kB
        Eric Yang

        Issue Links

          Activity

          Eric Yang created issue -
          Eric Yang made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-6255 [ HADOOP-6255 ]
          Eric Yang made changes -
          Attachment HDFS-1917.patch [ 12479007 ]
          Eric Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Remove packaging of duplicated third party jar files
          Assignee Eric Yang [ eyang ]
          Eric Yang made changes -
          Attachment HDFS-1917-1.patch [ 12479013 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.23.0 [ 12315571 ]
          Resolution Fixed [ 1 ]
          Todd Lipcon made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Tsz Wo Nicholas Sze made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue blocks HADOOP-6255 [ HADOOP-6255 ]
          Gavin made changes -
          Link This issue is depended upon by HADOOP-6255 [ HADOOP-6255 ]

            People

            • Assignee:
              Eric Yang
              Reporter:
              Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development