Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13687

Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2
    • build
    • None

    Description

      Currently, downstream projects that want to integrate with different Hadoop-compatible file systems like WASB and S3A need to list dependencies on each one. This creates an ongoing maintenance burden for those projects, because they need to update their build whenever a new Hadoop-compatible file system is introduced. This issue proposes adding a new artifact that transitively includes all Hadoop-compatible file systems. Similar to hadoop-client, this new artifact will consist of just a pom.xml listing the individual dependencies. Downstream users can depend on this artifact to sweep in everything, and picking up a new file system in a future version will be just a matter of updating the Hadoop dependency version.

      Attachments

        1. HADOOP-13687-trunk.006.patch
          8 kB
          Mingliang Liu
        2. HADOOP-13687-trunk.006.patch
          8 kB
          Chris Nauroth
        3. HADOOP-13687-trunk.005.patch
          8 kB
          Chris Nauroth
        4. HADOOP-13687-trunk.004.patch
          8 kB
          Chris Nauroth
        5. HADOOP-13687-trunk.003.patch
          469 kB
          Chris Nauroth
        6. HADOOP-13687-branch-2.003.patch
          8 kB
          Chris Nauroth
        7. HADOOP-13687-trunk.002.patch
          6 kB
          Chris Nauroth
        8. HADOOP-13687-branch-2.002.patch
          6 kB
          Chris Nauroth
        9. HADOOP-13687-trunk.001.patch
          7 kB
          Chris Nauroth
        10. HADOOP-13687-branch-2.001.patch
          6 kB
          Chris Nauroth

        Issue Links

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: