Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4097

Throw exception when too many dict slice eviction in AppendTrieDictionary

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v3.0.0
    • Component/s: None
    • Labels:
      None

      Description

      When the global dict is too large than the spark executor memory, there will be too many dict slice evictions and loads in AppendTrieDictionary, and  the build job will be very slow.

      It's better to throw an exception in advance in this case.

       

        Attachments

          Activity

            People

            • Assignee:
              liushaohui Shaohui Liu
              Reporter:
              liushaohui Shaohui Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: