Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15852 Improve query planning performance for wide nested schema
  3. SPARK-15794

Should truncate toString() of very wide schemas

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      With very wide tables, e.g. thousands of fields, the output is unreadable and often causes OOMs due to inefficient string processing.

      Attachments

        Activity

          People

            ekhliang Eric Liang
            ekhliang Eric Liang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: