Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4926

Optimize Global Dict building: replace operation 'mapPartitions.count()' with 'foreachPartitions'

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • v4.0.0-beta
    • v4.0.0
    • Spark Engine
    • None

    Description

      Replace operation 'mapPartitions.count()' with 'foreachPartitions' when building Global Dict

      Attachments

        Activity

          People

            zzcclp Zhichao Zhang
            zzcclp Zhichao Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: