Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35411

Essential information missing in TreeNode json string

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.1.1
    • Fix Version/s: 3.1.2, 3.2.0
    • Component/s: SQL
    • Labels:
      None

      Description

      TreeNode can be serialized to json string with the method toJSON() or prettyJson(). To avoid OOM issues, SPARK-17426 only keep part of Seq data that can be written out to result json string.
      Essential data like cteRelations in node With, branches in CaseWhen will be skipped and written out as null.

        Attachments

          Activity

            People

            • Assignee:
              ivoson huangtengfei
              Reporter:
              ivoson huangtengfei
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: