Uploaded image for project: 'Apache Gobblin'
  1. Apache Gobblin
  2. GOBBLIN-1207

Clear references to large objects in Fork, FileBasedExtractor, and HiveWritableHdfsDataWriter

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • None
    • None

    Description

      Fork, FileBasedExtractor, and HiveWritableHdfsDataWriter objects contain references to objects that can be large, such as ORC reader and writer buffers. Clear these references to allow the memory to be reclaimed during the job execution.

      Attachments

        Activity

          People

            Unassigned Unassigned
            hutran Hung Tran
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m