Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4007

Kylin concurrently builds a global dictionary for too long

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Cannot Reproduce
    • Affects Version/s: v2.6.1
    • Fix Version/s: None
    • Component/s: Job Engine
    • Labels:
      None

      Description

      When a dimension (user_id) is accurately calculated at the same time, the original data is in the order of millions, and the rowkey has the encoding type fixed_lengrh and length 100. It took a few hours or even failed in the build dimension dictionary step. After investigation, it was found that there are concurrent processes that want to obtain the lock corresponding to the cube / dict path, resulting in a deadlock.

        Attachments

        1. WechatIMG20.png
          36 kB
          mouxingya

          Activity

            People

            • Assignee:
              hit_lacus Xiaoxiang Yu
              Reporter:
              xingya mouxingya
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: