[ARROW-3987] [Java] Benchmark results for ARROW-1807

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Done
• Fix Version/s: 0.12.0
• Component/s: Java
• External issue URL: https://github.com/apache/arrow/issues/20590
• Assignee: shyam narayan singh
• Reporter: shyam narayan singh
• Created: 10/Dec/18 14:32
• Updated: 11/Jan/23 07:31
• Resolved: 10/Dec/18 15:37

Description

This is to record numbers for a test that has been done internally to compact ArrowBuf heap foot print by moving variables (udle, refcnt, isempty) to buffer ledger. It also removes the debug fields in ledger (buffers, historical log) to a different class.

Running a test that does 20000 allocations of arrow bufs and with ravindra's ongoing fix that does the slicing of arrow bufs, below are the results (without/with above fix)
Without above fix :
 
       Total Bytes: 13,028,109
       Total Classes: 2,367
       Total Instances: 193,471
       Classloaders: 77
       GC Roots: 1,641
       Number of Objects Pending for Finalization: 0
  
With above fix :
 
       Total Bytes: 12,700,115
       Total Classes: 2,373
       Total Instances: 193,635
       Classloaders: 82
       GC Roots: 1,642
       Number of Objects Pending for Finalization: 0
 
 
ArrowBuf size decreased from 109 bytes to 88 bytes and BufferLedger size increased from 80 bytes to 89 bytes.

Issue Links

• relates to: ARROW-1807 [JAVA] Reduce Heap Usage (Phase 3): consolidate buffers