[HDDS-6223] Ozone 1.1.0 client listKeys on FSO bucket returns empty list

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Implemented
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: Ozone Client, Ozone Manager
• Target Version/s: 1.3.0
• Assignee: Jyotinder Singh
• Reporter: Attila Doroszlai
• Created: 25/Jan/22 18:33
• Updated: 04/Jun/22 05:15
• Resolved: 04/Jun/22 05:15

Description

Ozone 1.1.0 or earlier client gets empty list for listKeys operation on FSO bucket in 1.3.0 cluster.

setup

$ cd hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/compose/xcompat
$ export COMPOSE_FILE=new-cluster.yaml:clients.yaml
$ docker-compose up -d --scale datanode=3
$ docker-compose exec new_client bash
bash-4.2$ ozone freon ockg -n1 -t1 -p test
bash-4.2$ ozone sh bucket info /vol1/bucket1
{
  "metadata" : { },
  "volumeName" : "vol1",
  "name" : "bucket1",
  "storageType" : "DISK",
  "versioning" : false,
  "usedBytes" : 805306368,
  "usedNamespace" : 1,
  "creationTime" : "2022-01-25T18:02:35.564Z",
  "modificationTime" : "2022-01-25T18:02:35.564Z",
  "quotaInBytes" : -1,
  "quotaInNamespace" : -1,
  "bucketLayout" : "FILE_SYSTEM_OPTIMIZED",
  "owner" : "hadoop",
  "link" : false
}
bash-4.2$ ozone sh key list /vol1/bucket1
[ {
  "volumeName" : "vol1",
  "bucketName" : "bucket1",
  "name" : "test/",
  "dataSize" : 0,
  "creationTime" : "2022-01-25T18:02:35.765Z",
  "modificationTime" : "2022-01-25T18:02:35.765Z",
  "replicationConfig" : {
    "replicationFactor" : "ONE",
    "requiredNodes" : 1,
    "replicationType" : "RATIS"
  },
  "replicationType" : "RATIS",
  "replicationFactor" : 1
}, {
  "volumeName" : "vol1",
  "bucketName" : "bucket1",
  "name" : "test/0",
  "dataSize" : 10240,
  "creationTime" : "2022-01-25T18:02:35.765Z",
  "modificationTime" : "2022-01-25T18:02:38.545Z",
  "replicationConfig" : {
    "replicationFactor" : "THREE",
    "requiredNodes" : 3,
    "replicationType" : "RATIS"
  },
  "replicationType" : "RATIS",
  "replicationFactor" : 3
} ]

repro

$ docker-compose exec old_client_1_0_0 ozone sh --verbose key list /vol1/bucket1
Volume Name : vol1
Bucket Name : bucket1
Found : 0 keys for bucket bucket1 in volume : vol1

Same happens with 1.1.0 client. 1.2.0+ client works fine. (These newer versions are being added in HDDS-6221.)

Also, 1.1.0 client works fine if bucket layout is OBJECT_STORE.

Issue Links

• Dependency: HDDS-6182 General Purpose Client Versioning
• Dependent: HDDS-5374 [FSO] Handle rename and delete operation from an old client to a FSO bucket type
• is a child of: HDDS-6390 Facilities for compatibility - umbrella jira
• is blocked by: HDDS-6213 Pluggable OzoneManager request handling hooks