[HADOOP-12877] Add ADLS telemetry instrumentation

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: fs/adl
• Target Version/s: 3.4.0
• Assignee: Vishwajeet Dusane
• Reporter: Vishwajeet Dusane
• Created: 03/Mar/16 11:35
• Updated: 28/Apr/21 19:31
• Resolved: 28/Apr/21 19:31

Description

Currently the connector/SDK adds these 4 telemetry fields to the User Agent suffix of each HTTP request to ADLS:

hadoop-azure-datalake-<version>/<version>/<clusterName>/<clusterType>

Field <clusterName> can be set by configuration property adl.events.tracking.clustername.
Field <clusterType> can be set by configuration property adl.events.tracking.clustertype.

The <version> string is repeated. It does not seem necessary.
All fields except the first are also added to HTTP request property x-ms-tracking-info.

Suggest adding a custom field to the user agent suffix and changing the first field to just "Hadoop":

Hadoop/<version>/<clusterName>/<clusterType>/<custom>

Field <custom> can be set by a new configuration property fs.adl.user.agent.suffix.