[HADOOP-16709] S3Guard: Make authoritative mode exclusive for metadata - don't check for expiry for authoritative paths

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Component/s: fs/s3
• Assignee: Gabor Bota
• Reporter: Rajesh Balamohan
• Created: 14/Nov/19 00:42
• Updated: 26/Nov/19 16:32
• Resolved: 26/Nov/19 16:32

Description

Authoritative mode has TTL which is set to 15 minutes by default. However, there are cases when we know for sure that the data wouldn't be changed/updated.

In certain cases, AppMaster ends up spending good amount of time in getSplits due to TTL expiry. It would be great to have an option to disable TTL (or specify as -1 when TTL shouldn't be checked).

Issue Links

• links to: GitHub Pull Request #1721