[HDFS-14683] WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Target Version/s: 3.3.0
• Assignee: Siyao Meng
• Reporter: Siyao Meng
• Created: 31/Jul/19 02:08
• Updated: 16/Dec/19 17:06
• Resolved: 02/Aug/19 00:16

Description

Quote [~jojochuang]'s comment:

ContentSummary has a field erasureCodingPolicy which was added in HDFS-11647, but webhdfs GETCONTENTSUMMARY doesn't include that.

Examples:

Directory, Before

GET /webhdfs/v1/tmp/?op=GETCONTENTSUMMARY HTTP/1.1

{
  "ContentSummary": {
    "directoryCount": 15,
    "fileCount": 1,
    "length": 180838,
    "quota": -1,
    "spaceConsumed": 542514,
    "spaceQuota": -1,
    "typeQuota": {}
  }
}

Directory, After, With EC policy RS-6-3-1024k set

GET /webhdfs/v1/tmp/?op=GETCONTENTSUMMARY HTTP/1.1

{
  "ContentSummary": {
    "directoryCount": 15,
    "ecPolicy": "RS-6-3-1024k",
    "fileCount": 1,
    "length": 180838,
    "quota": -1,
    "spaceConsumed": 542514,
    "spaceQuota": -1,
    "typeQuota": {}
  }
}

Directory, After, No EC policy set

GET /webhdfs/v1/tmp/?op=GETCONTENTSUMMARY HTTP/1.1

{
  "ContentSummary": {
    "directoryCount": 15,
    "ecPolicy": "",
    "fileCount": 1,
    "length": 180838,
    "quota": -1,
    "spaceConsumed": 542514,
    "spaceQuota": -1,
    "typeQuota": {}
  }
}

File, After, No EC policy set

GET /webhdfs/v1/tmp/file?op=GETCONTENTSUMMARY HTTP/1.1

{
  "ContentSummary": {
    "directoryCount": 0,
    "ecPolicy": "Replicated",
    "fileCount": 1,
    "length": 29,
    "quota": -1,
    "spaceConsumed": 29,
    "spaceQuota": -1,
    "typeQuota": {}
  }
}

Issue Links

• duplicates: HDFS-14671 WebHDFS: Add erasureCodingPolicy to ContentSummary
• is related to: HDFS-15063 HttpFS : getFileStatus doesn't return ecPolicy
• links to: GitHub Pull Request #1189