Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9424

Using AclCommand,avoid call the global method loadcache in SimpleAclAuthorizer

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: admin, tools
    • Labels:
      None
    • Environment:
      Linux,JDK7+

      Description

      In the class Named AclCommand,configure SimpleAclAuthorizer,but no need call loadCache.
      now we have 20,000 topics in kafka cluster,everytime I run AclCommand,all these topics's Alcs need to be authed, it will be very slow.
      The purpose of this optimization is:we can choose to not load the acl of all topics into memory, mainly for adding and deleting permissions.

      PR Available here: https://github.com/apache/kafka/pull/7706

      KIP Available here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-565%3A+Using+AclCommand%2Cavoid+call+the+global+method+loadcache+in+SimpleAclAuthorizer

      Issue Available here: https://issues.apache.org/jira/browse/KAFKA-9424

      mainly for adding and deleting permissions,we can choose to not load the acl of all topics into memory,then we can add two args "--load-acl-cache" "false" in AclCommand.main;else you don't add these args, it will load the acl cache defaultly.

      we can choose improve the running time from minutes to less than one second.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              StevenLu Steven Lu
              Reviewer:
              Rajini Sivaram

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 3h
                3h
                Remaining:
                Remaining Estimate - 3h
                3h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment