Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-11725

Ozone: Revise create container CLI specification and implementation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • ozone
    • None
    • Reviewed

    Description

      Per design doc in HDFS-11470

      hdfs scm -container create -p <pipelineID>
      
      Notes : This command connects to SCM and creates a container. Once the container is created in the SCM, the corresponding container is created at the appropriate datanode. Optional -p allows the user to control which pipeline to use while creating this container, this is strictly for debugging and testing.
      

      it has 2 problems with this design, 1st it does support a container name but it is quite useful for testing; 2nd it supports an optional option for pipeline, that is not quite necessary right now given SCM handles the creation of the pipelines, we might want to support this later. So proposed to revise the CLI to

      hdfs scm -container create -c <containerName>
      

      the -c option is required. Backend it does following steps

      1. Given the container name, ask SCM where the container should be replicated to. This returns a pipeline.
      2. Communicate with each datanode in the pipeline to create the container.

      this jira is to track the work to update both the design doc as well as the implementation.

      Attachments

        Activity

          People

            cheersyang Weiwei Yang
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: