Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-2811

Refine Spark Cubing to reduce serialization's overhead

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • v2.2.0
    • None
    • None

    Description

      In Spark Cubing, a lot of variables defined in driver and used in closures, which cause extra serialization's overhead.

      Meanwhile, remove the method of reading KylinConfig from HDFS.

      Attachments

        Activity

          People

            wormholer Wang Cheng
            wormholer Wang Cheng
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: