[HDFS-14718] HttpFS: Sort response by key names as WebHDFS does

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: httpfs
• Labels: pull-request-available
• Target Version/s: 3.5.0
• Assignee: Siyao Meng
• Reporter: Siyao Meng
• Created: 10/Aug/19 08:17
• Updated: 04/Jan/24 08:11

Description

Example

See description of HDFS-14665 for an example of LISTSTATUS.

Analysis

WebHDFS is using a TreeMap to serialize HdfsFileStatus, while HttpFS uses a LinkedHashMap to serialize FileStatus.

Questions

Why the difference? Is this intentional?

• I looked into the Git history. It seems it's simply because WebHDFS uses TreeMap from the beginning; and HttpFS uses LinkedHashMap from the beginning. It is not only limited to LISTSTATUS, but ALL other request's JSON serialization.

Now the real question: Could/Should we replace ALL LinkedHashMap into TreeMap in HttpFS serialization in FSOperations class?

Issue Links

• is a child of: HDFS-14665 HttpFS: LISTSTATUS response is missing HDFS-specific fields
• links to: GitHub Pull Request #1270