Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13687

Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: build
    • Labels:
      None

      Description

      Currently, downstream projects that want to integrate with different Hadoop-compatible file systems like WASB and S3A need to list dependencies on each one. This creates an ongoing maintenance burden for those projects, because they need to update their build whenever a new Hadoop-compatible file system is introduced. This issue proposes adding a new artifact that transitively includes all Hadoop-compatible file systems. Similar to hadoop-client, this new artifact will consist of just a pom.xml listing the individual dependencies. Downstream users can depend on this artifact to sweep in everything, and picking up a new file system in a future version will be just a matter of updating the Hadoop dependency version.

        Attachments

        1. HADOOP-13687-trunk.006.patch
          8 kB
          Mingliang Liu
        2. HADOOP-13687-trunk.006.patch
          8 kB
          Chris Nauroth
        3. HADOOP-13687-trunk.005.patch
          8 kB
          Chris Nauroth
        4. HADOOP-13687-trunk.004.patch
          8 kB
          Chris Nauroth
        5. HADOOP-13687-trunk.003.patch
          469 kB
          Chris Nauroth
        6. HADOOP-13687-branch-2.003.patch
          8 kB
          Chris Nauroth
        7. HADOOP-13687-trunk.002.patch
          6 kB
          Chris Nauroth
        8. HADOOP-13687-branch-2.002.patch
          6 kB
          Chris Nauroth
        9. HADOOP-13687-trunk.001.patch
          7 kB
          Chris Nauroth
        10. HADOOP-13687-branch-2.001.patch
          6 kB
          Chris Nauroth

          Issue Links

            Activity

              People

              • Assignee:
                cnauroth Chris Nauroth
                Reporter:
                cnauroth Chris Nauroth
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: