[HDDS-6924] OBJECT_STORE isn't flat namespaced

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: Ozone Manager
• Labels: pull-request-available
• Target Version/s: 1.3.0
• Assignee: Rakesh Radhakrishnan
• Reporter: Soumitra Sulav
• Created: 18/Jun/22 16:29
• Updated: 21/Jun/22 04:18
• Resolved: 21/Jun/22 04:18

Description

As per the design, the OBJECT_STORE bucket layout should be flat namespaced.

But while trying to create a single key in the OBJECT_STORE, there was more than 1 entry added to the key list.
And many of the KEYS seem invalid.

[root@quasar-dsaqtf-1 ~]# /opt/cloudera/parcels/CDH/bin/ozone sh bucket create o3://ozone1/prefix67032/layoutobs -l OBJECT_STORE
22/06/18 15:55:27 INFO rpc.RpcClient: Creating Bucket: prefix67032/layoutobs, with the Bucket Layout OBJECT_STORE, systest as owner, Versioning false, Storage Type set to DISK and Encryption set to false
[root@quasar-dsaqtf-1 ~]# /opt/cloudera/parcels/CDH/bin/ozone sh key put o3://ozone1/prefix67032/layoutobs//SRCDIR///FILE1.txt anaconda-ks.cfg
22/06/18 15:55:50 WARN impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-xceiverclientmetrics.properties,hadoop-metrics2.properties
22/06/18 15:55:50 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
22/06/18 15:55:50 INFO impl.MetricsSystemImpl: XceiverClientMetrics metrics system started
22/06/18 15:55:51 INFO metrics.MetricRegistries: Loaded MetricRegistries class org.apache.ratis.metrics.impl.MetricRegistriesImpl
[root@quasar-dsaqtf-1 ~]# /opt/cloudera/parcels/CDH/bin/ozone sh key list o3://ozone1/prefix67032/layoutobs
[ {
  "volumeName" : "prefix67032",
  "bucketName" : "layoutobs",
  "name" : "/",
  "dataSize" : 0,
  "creationTime" : "2022-06-18T15:55:50.085Z",
  "modificationTime" : "2022-06-18T15:55:50.085Z",
  "replicationConfig" : {
    "replicationFactor" : "THREE",
    "requiredNodes" : 3,
    "replicationType" : "RATIS"
  }
}, {
  "volumeName" : "prefix67032",
  "bucketName" : "layoutobs",
  "name" : "/SRCDIR/",
  "dataSize" : 0,
  "creationTime" : "2022-06-18T15:55:50.085Z",
  "modificationTime" : "2022-06-18T15:55:50.085Z",
  "replicationConfig" : {
    "replicationFactor" : "THREE",
    "requiredNodes" : 3,
    "replicationType" : "RATIS"
  }
}, {
  "volumeName" : "prefix67032",
  "bucketName" : "layoutobs",
  "name" : "/SRCDIR///FILE1.txt",
  "dataSize" : 3322,
  "creationTime" : "2022-06-18T15:55:50.085Z",
  "modificationTime" : "2022-06-18T15:55:52.081Z",
  "replicationConfig" : {
    "replicationFactor" : "THREE",
    "requiredNodes" : 3,
    "replicationType" : "RATIS"
  }
}, {
  "volumeName" : "prefix67032",
  "bucketName" : "layoutobs",
  "name" : "/SRCDIR/FILE1.txt/",
  "dataSize" : 0,
  "creationTime" : "2022-06-18T15:55:50.085Z",
  "modificationTime" : "2022-06-18T15:55:50.085Z",
  "replicationConfig" : {
    "replicationFactor" : "THREE",
    "requiredNodes" : 3,
    "replicationType" : "RATIS"
  }
} ]

Also, all the listed KEYS are treated as actual OBJECTS with REPLICATION as 3.

Issue Links

• links to: GitHub Pull Request #3533