Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-40

Separating packaging of Ozone/HDDS from the main Hadoop

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.1
    • Component/s: None
    • Labels:
      None

      Description

      According to the community vote, Ozone/Hdds release cycle should be independent from the Hadoop release cycle.

      To make it possible we need a separated ozone package.

      The current state:

      We have just one output tar/directory under hadoop-dist (hadoop-3.2.0). It includes all the hdfs/yarn/mapreduce/hdds binaries and libraries. (Jar files are put in separated directory).

      The hdds components and hdfs compobebts all could be started from the bin.

      Proposed version

      Create a sepearated hadoop-dist/ozone-2.1.0 which contains only the hdfs AND hdds components. Both the hdfs namenode and hdds datanode/scm/ksm could be started from the ozone-2.1.0 package.

      Hdds packages would be removed from the original hadoop-3.2.0 directory.

      This is a relatively small change. On further JIRAs we need to :

      • Create a shaded datanode plugin which could be used with any existing hadoop cluster
      • Use standalone ObjectStore/Ozone server instead of the Namenode+Datanod plugin.
      • Add test cases for both the ozone-only and the mixed clusters (ozone + hdfs)

        Attachments

        1. HDDS-40.001.patch
          22 kB
          Marton Elek
        2. HDDS-40.002.patch
          30 kB
          Marton Elek
        3. HDDS-40.003.patch
          30 kB
          Marton Elek
        4. HDDS-40.004.patch
          30 kB
          Marton Elek

          Activity

            People

            • Assignee:
              elek Marton Elek
              Reporter:
              elek Marton Elek
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: