Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3810

Kylin service nodes discovery with Zookeeper

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: v2.3.1
    • Fix Version/s: None
    • Component/s: Metadata, Others
    • Labels:
      None

      Description

      由于Kylin的元数据同步使用了Boardcast类中的线程池,所以一旦负载均衡查询节点中一台机器岩机,Kylin的同步请求线程会堵塞在岩机的查询节点,最后将线程资源全部占满,如图同步到1,2节点的请求堵塞在线程队列中导致查询节点获取不到最新元数据从而无法查询到实时构建好的数据

      我们的方案:
      引进了服务发现组建zookeeper

        Attachments

        1. 引入zookeeper.png
          38 kB
          zhangwei
        2. 同步阻塞.png
          36 kB
          zhangwei
        3. zookeeperCacheSync.patch
          21 kB
          zhangwei

        Issue Links

          Activity

            People

            • Assignee:
              photogamrun zhangwei
              Reporter:
              photogamrun zhangwei

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment