[HADOOP-18542] Azure Token provider requires tenant and client IDs despite being optional

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.2, 3.3.3, 3.3.4
• Fix Version/s: 3.5.0, 3.4.1
• Component/s: fs/azure, hadoop-thirdparty
• Labels: pull-request-available
• Flags: Patch
• Assignee: Unassigned
• Reporter: Carl
• Created: 28/Nov/22 12:30
• Updated: 21/Aug/24 13:17
• Resolved: 21/Aug/24 13:17

Description

The `AbfsConfiguration` class requires that we provide a tenant and client ID when using the `MsiTokenProvider` class to fetch an authentication token. The bug is that those fields are not required by the Azure API, which can infer those fields when the call is made from an Azure instance.

The fix is to make tenant and client ID optional when getting an Azure token from the Azure Metadata Service.

A fix has been submitted here: https://github.com/apache/hadoop/pull/4262

The bug was introduced with HADOOP-17725  (https://github.com/apache/hadoop/pull/3041/files)

Issue Links

• is caused by: HADOOP-17725 Improve error message for token providers in ABFS
• links to: GitHub Pull Request #4262