Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14098 Generate Java code to build CachedColumnarBatch and get values from CachedColumnarBatch when DataFrame.cache() is called
  3. SPARK-20770

Improve ColumnStats

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • SQL
    • None

    Description

      We improve the implementation of ColumnStats by using the following approaches.

      1. Declare subclasses of ColumnStats as final
      2. Remove unnecessary call of row.isNullAt(ordinal)
      3. Remove the dependency on GenericInternalRow

      Attachments

        Activity

          People

            kiszk Kazuaki Ishizaki
            kiszk Kazuaki Ishizaki
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: