[HADOOP-16130] Support delegation token operations in KMS Benchmark - ASF JIRA

Add vote

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: 3.3.0
Fix Version/s: None
Component/s: None
Labels:
None

Description

At the last Hadoop Contributors Meetup, Daryn Sharp shared another KMS throughput bottleneck is ZooKeeper – KMS uses ZK to store delegation tokens. ZK would be brought to a halt when expired delegation tokens are purged. That sounds critical especially given that in most deployments KMS share the same ZK quorum as HDFS, it would cause NameNode failover.

The current KMS benchmark does not support delegation token operations (addDelegationTokens, cancelDelegationToken, renewDelegationToken) so it's hard to understand how bad it is, and hard to quantify the improvement of a fix.

File this jira to support those operations before we move on to the fix for the ZK issue.