Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9424

Using AclCommand,avoid call the global method loadcache in SimpleAclAuthorizer

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • admin, tools
    • None
    • Linux,JDK7+

    Description

      In the class Named AclCommand,configure SimpleAclAuthorizer,but no need call loadCache.
      now we have 20,000 topics in kafka cluster,everytime I run AclCommand,all these topics's Alcs need to be authed, it will be very slow.
      The purpose of this optimization is:we can choose to not load the acl of all topics into memory, mainly for adding and deleting permissions.

      PR Available here: https://github.com/apache/kafka/pull/7706

      KIP Available here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-565%3A+Using+AclCommand%2Cavoid+call+the+global+method+loadcache+in+SimpleAclAuthorizer

      Issue Available here: https://issues.apache.org/jira/browse/KAFKA-9424

      mainly for adding and deleting permissions,we can choose to not load the acl of all topics into memory,then we can add two args "--load-acl-cache" "false" in AclCommand.main;else you don't add these args, it will load the acl cache defaultly.

      we can choose improve the running time from minutes to less than one second.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            StevenLu Steven Lu
            Rajini Sivaram Rajini Sivaram

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 3h
                3h
                Remaining:
                Remaining Estimate - 3h
                3h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment