Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3810

Kylin service nodes discovery with Zookeeper

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: v2.3.1
    • Fix Version/s: None
    • Component/s: Metadata, Others
    • Labels:
      None

      Description

      由于Kylin的元数据同步使用了Boardcast类中的线程池,所以一旦负载均衡查询节点中一台机器岩机,Kylin的同步请求线程会堵塞在岩机的查询节点,最后将线程资源全部占满,如图同步到1,2节点的请求堵塞在线程队列中导致查询节点获取不到最新元数据从而无法查询到实时构建好的数据

      我们的方案:
      引进了服务发现组建zookeeper

        Attachments

        1. zookeeperCacheSync.patch
          21 kB
          zhangwei
        2. 同步阻塞.png
          36 kB
          zhangwei
        3. 引入zookeeper.png
          38 kB
          zhangwei

          Issue Links

            Activity

              People

              • Assignee:
                photogamrun zhangwei
                Reporter:
                photogamrun zhangwei
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: