Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1851

Improve build dictionary, consider that input is already sorted

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • v2.0.0
    • Job Engine
    • None

    Description

      Currently dictionary build may encounter OOM when cardinality is huge. This can benefit from that the input (which is the output of FactDistinctColumn reducer) is already sorted.

      Attachments

        Issue Links

          contains

          Improvement - An improvement or enhancement to an existing feature or task. KYLIN-1178 Build dictionary in Hadoop cluster

          • Major - Major loss of function.
          • Closed

          Activity

            People

              xiefan46 XIE FAN
              liyang.gmt8@gmail.com liyang
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: