Major Description
Per design doc in HDFS-11470
hdfs scm -container create -p <pipelineID> Notes : This command connects to SCM and creates a container. Once the container is created in the SCM, the corresponding container is created at the appropriate datanode. Optional -p allows the user to control which pipeline to use while creating this container, this is strictly for debugging and testing.
it has 2 problems with this design, 1st it does support a container name but it is quite useful for testing; 2nd it supports an optional option for pipeline, that is not quite necessary right now given SCM handles the creation of the pipelines, we might want to support this later. So proposed to revise the CLI to
hdfs scm -container create -c <containerName>
the -c option is required. Backend it does following steps
- Given the container name, ask SCM where the container should be replicated to. This returns a pipeline.
- Communicate with each datanode in the pipeline to create the container.
this jira is to track the work to update both the design doc as well as the implementation.