Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3394

Prepare for Kafka 2.0

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Backlog
    • Component/s: None
    • Labels:

      Description

      Kafka 2.0 has been released.

      I got the following when compiling against Kafka 2.0.0:

      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:266: error: type mismatch;
      [ERROR]  found   : Option[org.apache.kafka.common.Node]
      [ERROR]  required: org.apache.kafka.common.Node
      [ERROR]                 getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, List(l)).head.getNode(listenerName)
      [ERROR]                                                                                        ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:273: error: type mismatch;
      [ERROR]  found   : Seq[Option[org.apache.kafka.common.Node]]
      [ERROR]  required: Seq[org.apache.kafka.common.Node]
      [ERROR]             replicaInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, replicas).map(_.getNode(listenerName))
      [ERROR]                                                                                          ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:274: error: type mismatch;
      [ERROR]  found   : Seq[Option[org.apache.kafka.common.Node]]
      [ERROR]  required: Seq[org.apache.kafka.common.Node]
      [ERROR]             isrInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, inSyncReplicas).map(_.getNode(listenerName))
      [ERROR]                                                                                            ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:476: error: value getConsumersInGroup is not a member of kafka.utils.ZkUtils
      [ERROR]     zkUtils.getConsumersInGroup(group).nonEmpty
      [ERROR]             ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:489: error: not found: type ZKGroupDirs
      [ERROR]       val dir = new ZKGroupDirs(group)
      [ERROR]                     ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:507: error: value getTopicsByConsumerGroup is not a member of kafka.utils.ZkUtils
      [ERROR]     val topics = zkUtils.getTopicsByConsumerGroup(group)
      [ERROR]                          ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:512: error: not found: type ZKGroupTopicDirs
      [ERROR]       val dir = new ZKGroupTopicDirs(group, topic)
      [ERROR]                     ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:528: error: value getAllConsumerGroupsForTopic is not a member of kafka.utils.ZkUtils
      [ERROR]     val groups = zkUtils.getAllConsumerGroupsForTopic(topic)
      [ERROR]                          ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:720: error: value encode is not a member of object kafka.utils.Json
      [ERROR]     val content = Json.encode(getConfigChangeZnodeData(sanitizedEntityPath))
      [ERROR]                        ^
      [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:733: error: value encode is not a member of object kafka.utils.Json
      [ERROR]     zkUtils.updatePersistentPath(entityPath, Json.encode(map))
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yuzhihong@gmail.com Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: