Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22378

Redundant nullcheck is generated for extracting value in complex types

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Redundant null check is generated in the code for extracting an element from complex types GetArrayItem, GetMapValue, and GetArrayStructFields. Since these code generations do not take care of nullable in DataType such as ArrayType, the generated code always has isNullAt(index).

        Attachments

          Activity

            People

            • Assignee:
              kiszk Kazuaki Ishizaki
              Reporter:
              kiszk Kazuaki Ishizaki
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: