Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33091

Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.1, 3.1.0
    • Fix Version/s: 3.0.2, 3.1.0
    • Component/s: SQL
    • Labels:
      None

      Description

      This is a kind of a followup of SPARK-32646. New JIRA was filed to control the fixed versions properly.

      When you use map, it might be lazily evaluated and not executed. To avoid this, we should better use foreach.

      See also SPARK-16694

        Attachments

          Activity

            People

            • Assignee:
              hyukjin.kwon Hyukjin Kwon
              Reporter:
              hyukjin.kwon Hyukjin Kwon

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment