[HDDS-11069] Block location is missing in output of Ozone debug chunkinfo command for EC

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0, 1.4.1
• Component/s: Ozone CLI
• Labels: pull-request-available
• Target Version/s: 1.4.1
• Assignee: Sadanand Shenoy
• Reporter: Karn Kumar Singh
• Created: 26/Jun/24 08:43
• Updated: 31/Jul/24 03:50
• Resolved: 12/Jul/24 08:19

Description

Block location is missing in the output of the Ozone debug chunkinfo command for EC.

Repro Steps:

1. Perform the key put operation on the EC bucket(Encryption enabled).
2. Run the ozone debug chunkinfo command.

Log:

2024-06-26 03:29:58,234|INFO|MainThread|machine.py:190 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|RUNNING: /opt/cloudera/parcels/CDH/bin/ozone debug chunkinfo o3://ozone1719362459/vol-fs-enc1719372557-1719372557/buck-fs-enc1719372557-1719372557/file_1719372566
2024-06-26 03:30:05,010|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|24/06/26 03:30:05 WARN impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-xceiverclientmetrics.properties,hadoop-metrics2.properties
2024-06-26 03:30:05,099|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|24/06/26 03:30:05 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
2024-06-26 03:30:05,099|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|24/06/26 03:30:05 INFO impl.MetricsSystemImpl: XceiverClientMetrics metrics system started
2024-06-26 03:30:08,930|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,930|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"KeyLocations": [
2024-06-26 03:30:08,931|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|[
2024-06-26 03:30:08,931|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,931|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-HostName": "x",
2024-06-26 03:30:08,931|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-IP": "x.x.x.x",
2024-06-26 03:30:08,931|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Container-ID": 1001,
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Block-ID": 113750153625603006,
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Locations": {
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"files": [],
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"pipelineID": "2123027d-35aa-4dd1-9cb2-e0ab04d921a1",
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"chunkType": "DATA"
2024-06-26 03:30:08,932|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|},
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-HostName": "x",
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-IP": "x.x.x.x",
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Container-ID": 1001,
2024-06-26 03:30:08,933|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Block-ID": 113750153625603006,
2024-06-26 03:30:08,934|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Locations": {
2024-06-26 03:30:08,934|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"files": [],
2024-06-26 03:30:08,934|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"pipelineID": "2123027d-35aa-4dd1-9cb2-e0ab04d921a1",
2024-06-26 03:30:08,934|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"chunkType": "PARITY"
2024-06-26 03:30:08,934|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|},
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-HostName": "x",
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-IP": "x.x.x.x",
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Container-ID": 1001,
2024-06-26 03:30:08,935|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Block-ID": 113750153625603006,
2024-06-26 03:30:08,936|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Locations": {
2024-06-26 03:30:08,936|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"files": [],
2024-06-26 03:30:08,936|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"pipelineID": "2123027d-35aa-4dd1-9cb2-e0ab04d921a1",
2024-06-26 03:30:08,936|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"chunkType": "DATA"
2024-06-26 03:30:08,936|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|},
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-HostName": "x",
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-IP": "x.x.x.x",
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Container-ID": 1001,
2024-06-26 03:30:08,937|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Block-ID": 113750153625603006,
2024-06-26 03:30:08,938|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Locations": {
2024-06-26 03:30:08,938|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"files": [],
2024-06-26 03:30:08,941|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"pipelineID": "2123027d-35aa-4dd1-9cb2-e0ab04d921a1",
2024-06-26 03:30:08,942|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"chunkType": "DATA"
2024-06-26 03:30:08,942|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,942|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|},
2024-06-26 03:30:08,942|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|{
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-HostName": "x",
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Datanode-IP": "x.x.x.x",
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Container-ID": 1001,
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Block-ID": 113750153625603006,
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"Locations": {
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"files": [],
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"pipelineID": "2123027d-35aa-4dd1-9cb2-e0ab04d921a1",
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|"chunkType": "PARITY"
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|]
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|]
2024-06-26 03:30:08,943|INFO|MainThread|machine.py:205 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|}
2024-06-26 03:30:09,323|INFO|MainThread|machine.py:231 - run()||GUID=4ad70fd9-bcc9-4596-9631-0002f573b608|Exit Code: 0 

Issue Links

• links to: GitHub Pull Request #6909