Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2305

Memory leak when using DataFrame.coalesce

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • spark-integration
    • None

    Description

      When using DataFrame.coalesce, taskContext object holds reader’s reference until the task finished and
      coalesce combines a lot of CarbonSparkPartition into one task.

      Attachments

        Activity

          People

            Unassigned Unassigned
            xaprice Jin Zhou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: