Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7425

Kafka Broker -Unable to start

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 1.0.0
    • None
    • None
    • None

    Description

      Hello Team,

      We are facing below Error, While starting Kafka Broker .

      By disabling below property in server.properties , we can able to up Broker , But we are missing ACL authentication with Kafka Brokers.

      ##########

      server.properties (Config File)

      authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer

      ############

       

      Please help and suggest on below error .

      Error Log :

      2018-09-20 13:50:54,121 INFO kafka.coordinator.transaction.TransactionCoordinator: [TransactionCoordinator id=4] Startup complete.
      2018-09-20 13:50:54,238 FATAL kafka.server.KafkaServer: [KafkaServer id=4] Fatal error during KafkaServer startup. Prepare to shutdown
      kafka.common.KafkaException: DelegationToken not a valid resourceType name. The valid names are Topic,Group,Cluster,TransactionalId
      at kafka.security.auth.ResourceType$.$anonfun$fromString$2(ResourceType.scala:56)
      at scala.Option.getOrElse(Option.scala:121)
      at kafka.security.auth.ResourceType$.fromString(ResourceType.scala:56)
      at kafka.security.auth.SimpleAclAuthorizer.$anonfun$loadCache$2(SimpleAclAuthorizer.scala:233)
      at kafka.security.auth.SimpleAclAuthorizer.$anonfun$loadCache$2$adapted(SimpleAclAuthorizer.scala:232)
      at scala.collection.Iterator.foreach(Iterator.scala:929)
      at scala.collection.Iterator.foreach$(Iterator.scala:929)
      at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
      at scala.collection.IterableLike.foreach(IterableLike.scala:71)
      at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
      at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
      at kafka.security.auth.SimpleAclAuthorizer.$anonfun$loadCache$1(SimpleAclAuthorizer.scala:232)
      at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
      at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:217)
      at kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:225)
      at kafka.security.auth.SimpleAclAuthorizer.loadCache(SimpleAclAuthorizer.scala:230)
      at kafka.security.auth.SimpleAclAuthorizer.configure(SimpleAclAuthorizer.scala:114)
      at kafka.server.KafkaServer.$anonfun$startup$4(KafkaServer.scala:254)
      at scala.Option.map(Option.scala:146)
      at kafka.server.KafkaServer.startup(KafkaServer.scala:252)
      at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
      at kafka.Kafka$.main(Kafka.scala:92)
      at kafka.Kafka.main(Kafka.scala)
      2018-09-20 13:50:54,241 INFO kafka.server.KafkaServer: [KafkaServer id=4] shutting down
      2018-09-20 13:50:54,242 INFO kafka.network.SocketServer: [SocketServer brokerId=4] Shutting down
      2018-09-20 13:50:54,260 INFO kafka.network.SocketServer: [SocketServer brokerId=4] Shutdown completed
      2018-09-20 13:50:54,267 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-topic]: Shutting down
      2018-09-20 13:50:54,451 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-topic]: Shutdown completed
      2018-09-20 13:50:54,451 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-topic]: Stopped
      2018-09-20 13:50:54,453 INFO kafka.coordinator.transaction.TransactionCoordinator: [TransactionCoordinator id=4] Shutting down.
      2018-09-20 13:50:54,454 INFO kafka.coordinator.transaction.ProducerIdManager: [ProducerId Manager 4]: Shutdown complete: last producerId assigned 1559000
      2018-09-20 13:50:54,455 INFO kafka.coordinator.transaction.TransactionStateManager: [Transaction State Manager 4]: Shutdown complete
      2018-09-20 13:50:54,455 INFO kafka.coordinator.transaction.TransactionMarkerChannelManager: [Transaction Marker Channel Manager 4]: Shutting down
      2018-09-20 13:50:54,455 INFO kafka.coordinator.transaction.TransactionMarkerChannelManager: [Transaction Marker Channel Manager 4]: Stopped
      2018-09-20 13:50:54,455 INFO kafka.coordinator.transaction.TransactionMarkerChannelManager: [Transaction Marker Channel Manager 4]: Shutdown completed
      2018-09-20 13:50:54,456 INFO kafka.coordinator.transaction.TransactionCoordinator: [TransactionCoordinator id=4] Shutdown complete.
      2018-09-20 13:50:54,456 INFO kafka.coordinator.group.GroupCoordinator: [GroupCoordinator 4]: Shutting down.
      2018-09-20 13:50:54,457 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Heartbeat]: Shutting down
      2018-09-20 13:50:54,653 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Heartbeat]: Shutdown completed
      2018-09-20 13:50:54,653 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Heartbeat]: Stopped
      2018-09-20 13:50:54,653 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Rebalance]: Shutting down
      2018-09-20 13:50:54,853 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Rebalance]: Stopped
      2018-09-20 13:50:54,854 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Rebalance]: Shutdown completed
      2018-09-20 13:50:54,855 INFO kafka.coordinator.group.GroupCoordinator: [GroupCoordinator 4]: Shutdown complete.
      2018-09-20 13:50:54,856 INFO kafka.server.ReplicaManager: [ReplicaManager broker=4] Shutting down
      2018-09-20 13:50:54,856 INFO kafka.server.ReplicaManager$LogDirFailureHandler: [LogDirFailureHandler]: Shutting down
      2018-09-20 13:50:54,856 INFO kafka.server.ReplicaManager$LogDirFailureHandler: [LogDirFailureHandler]: Shutdown completed
      2018-09-20 13:50:54,856 INFO kafka.server.ReplicaManager$LogDirFailureHandler: [LogDirFailureHandler]: Stopped
      2018-09-20 13:50:54,857 INFO kafka.server.ReplicaFetcherManager: [ReplicaFetcherManager on broker 4] shutting down
      2018-09-20 13:50:54,859 INFO kafka.server.ReplicaFetcherManager: [ReplicaFetcherManager on broker 4] shutdown completed
      2018-09-20 13:50:54,859 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Fetch]: Shutting down
      2018-09-20 13:50:54,994 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Fetch]: Stopped
      2018-09-20 13:50:54,994 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Fetch]: Shutdown completed
      2018-09-20 13:50:54,995 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Produce]: Shutting down
      2018-09-20 13:50:55,194 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Produce]: Stopped
      2018-09-20 13:50:55,194 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-Produce]: Shutdown completed
      2018-09-20 13:50:55,194 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-DeleteRecords]: Shutting down
      2018-09-20 13:50:55,195 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-DeleteRecords]: Stopped
      2018-09-20 13:50:55,195 INFO kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper: [ExpirationReaper-4-DeleteRecords]: Shutdown completed
      2018-09-20 13:50:55,202 INFO kafka.server.ReplicaManager: [ReplicaManager broker=4] Shut down completely
      2018-09-20 13:50:55,203 INFO kafka.log.LogManager: Shutting down.
      2018-09-20 13:50:55,205 INFO kafka.log.LogCleaner: Shutting down the log cleaner.
      2018-09-20 13:50:55,205 INFO kafka.log.LogCleaner: [kafka-log-cleaner-thread-0]: Shutting down
      2018-09-20 13:50:55,205 INFO kafka.log.LogCleaner: [kafka-log-cleaner-thread-0]: Stopped
      2018-09-20 13:50:55,205 INFO kafka.log.LogCleaner: [kafka-log-cleaner-thread-0]: Shutdown completed
      2018-09-20 13:50:55,449 INFO kafka.log.LogManager: Shutdown complete.
      2018-09-20 13:50:55,467 INFO kafka.server.KafkaServer: [KafkaServer id=4] shut down completed
      2018-09-20 13:50:55,467 FATAL kafka.server.KafkaServerStartable: Exiting Kafka.
      2018-09-20 13:50:55,469 INFO kafka.server.KafkaServer: [KafkaServer id=4] shutting down
      bash-4.2$

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-7216 Exception while running kafka-acls.sh from 1.0 env on target Kafka env with 1.1.1

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              sathish051 Sathish Yanamala
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: