[HADOOP-17065] Adding Network Counters in ABFS

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.1
• Component/s: fs/azure
• Assignee: Mehakmeet Singh
• Reporter: Mehakmeet Singh
• Created: 04/Jun/20 13:51
• Updated: 17/May/21 09:04
• Resolved: 27/Aug/20 14:16

Description

Network Counters to be added in ABFS:

CONNECTIONS_MADE	Number of times connection was made with Azure Data Lake
SEND_REQUESTS	Number of send requests
GET_RESPONSE	Number of response gotten
BYTES_SEND	Number of bytes send
BYTES_RECEIVED	Number of bytes received
READ_THROTTLE	Number of times throttled while read operation
WRITE_THROTTLE	Number of times throttled while write operation

propose:

• Adding these counters as part of AbfsStatistic already made in HADOOP-17016.
• Increment of counters across Abfs Network services.

Issue Links

• breaks: HADOOP-17702 HADOOP-17065 breaks compatibility between 3.3.0 and 3.3.1
• relates to: HADOOP-17671 Run jacc to check for Hadoop's Java API compat