Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.3.0
-
None
-
None
-
None
Description
At the last Hadoop Contributors Meetup, Daryn Sharp shared another KMS throughput bottleneck is ZooKeeper – KMS uses ZK to store delegation tokens. ZK would be brought to a halt when expired delegation tokens are purged. That sounds critical especially given that in most deployments KMS share the same ZK quorum as HDFS, it would cause NameNode failover.
The current KMS benchmark does not support delegation token operations (addDelegationTokens, cancelDelegationToken, renewDelegationToken) so it's hard to understand how bad it is, and hard to quantify the improvement of a fix.
File this jira to support those operations before we move on to the fix for the ZK issue.
Attachments
Issue Links
- relates to
-
HADOOP-15967 KMS Benchmark Tool
- Resolved