[HADOOP-16612] Track Azure Blob File System client-perceived latency

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.2
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: fs/azure, hdfs-client

Docs Text

Add instrumentation code to time the Azure Blob File System API performance
Add a feature switch to optionally enable this feature
Add unit tests for correctness and performance

• Assignee: Jeetesh Mangwani
• Reporter: Jeetesh Mangwani
• Created: 27/Sep/19 02:36
• Updated: 26/Jul/23 13:23
• Resolved: 09/Dec/19 06:00

Description

Track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency in the Hadoop ABFS driver.

The latency information is sent back to the ADLS Gen 2 REST API endpoints in the subsequent requests.

Here's the PR: https://github.com/apache/hadoop/pull/1611

Issue Links

• causes: HADOOP-18826 abfs getFileStatus(/) fails with "Value for one of the query parameters specified in the request URI is invalid.", 400
• links to: GitHub Pull Request #1611
• links to: GitHub Pull Request #1734
• links to: PR 1611