[HDFS-17148] RBF: SQLDelegationTokenSecretManager must cleanup expired tokens in SQL

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: rbf
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Hector Sandoval Chaverri
• Reporter: Hector Sandoval Chaverri
• Created: 08/Aug/23 17:51
• Updated: 28/Jan/24 01:47
• Resolved: 11/Aug/23 20:04

Description

The SQLDelegationTokenSecretManager fetches tokens from SQL and stores them temporarily in a memory cache with a short TTL. The ExpiredTokenRemover in AbstractDelegationTokenSecretManager runs periodically to cleanup any expired tokens from the cache, but most tokens have been evicted automatically per the TTL configuration. This leads to many expired tokens in the SQL database that should be cleaned up.

The SQLDelegationTokenSecretManager should find expired tokens in SQL instead of in the memory cache when running the periodic cleanup.

Issue Links

• links to: GitHub Pull Request #5936
• links to: GitHub Pull Request #5966