[SLING-5990] [SCD] FileBackedMemoryOutputStream is 10x slower than file buffering for large files

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: Content Distribution Core 0.2.0
• Fix Version/s: Content Distribution Core 0.2.0
• Component/s: Content Distribution
• Assignee: Timothee Maret
• Reporter: Timothee Maret
• Created: 23/Aug/16 15:05
• Updated: 14/Feb/17 09:30
• Resolved: 23/Aug/16 15:43

Description

When doing performance test SDC agents and the following configuration, the distribution is ~10x slower than when using a regular file buffering method.

The parameters are the following

• fileThreashol = 1
• memoryUnit = MB
• useOffHeapMemory = false
• tempDirectory = null
• fileName = distrpck-create-
• fileExtension = .default

The size of the binary is 80MB.
With the setup, it takes 12-14sec to replicate
With a simple FileOutputStream mechanism, it takes around 1.4 sec to replicate

Issue Links

• is related to: SLING-5991 [SCD] Evaluate avoiding to buffer the whole packages before streaming