Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-446

Provide shaded artifact to start ozone service as a datanode plugin

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.2.1
    • None
    • None

    Description

      Ozone datanode service could be started in two different way:

      1. as a standalone process
      2. as a datanode plugin

      We tested the second scenarion by compiling both ozone + hadoop trunk together and created a combined artifact. But we have no more full hadoop distribution in the ozone release package any more. And we had no answer how it could be started with an existing hadoop release.

      We need a well defined way to add the datanode-service to the classpath of the hadoop datanode.

      I propose here to create a lightweight shaded artifact (and here the shading only combines all the classes together without package name refactoring) to make it easier to extend an existing hadoop installation.

      In this patch I add the shade plugin execution to the ozone objectstore-service and the shaded file will be copied to the distribution.

      A new docker-compose based execution environment (ozone-hdfs) demonstrates/tests how it could work.

      Tested with hadoop 3.1.0 and datanode service could be started without any problem

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            elek Marton Elek Assign to me
            elek Marton Elek
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment