[#OPENJPA-71] Caching primitive array types consumes excessive memory

OpenJPA

Caching primitive array types consumes excessive memory

Created: 31/Oct/06 01:06 AM Updated: 09/Mar/07 11:11 AM

Return to search

Component/s:

datacache

Affects Version/s:

0.9.0, 0.9.6

Fix Version/s:

0.9.7

Time Tracking:

Not Specified

Resolution Date:

08/Mar/07 09:34 AM

Description

« Hide

As reported on the mailing list: http://www.nabble.com/cached-byte---consumes-excessive-memory-tf2543098.html , in org.apache.openjpa.AbstractPCData#toData() an ArrayList is used to cache all types of arrays, including arrays of primitives. This can use excessively large amounts of memory because of the wrappers required for each element in the array. In one test case, a 7MB byte[] consumed 127MB when converted to a cached ArrayList.

AbstractPCData needs to be fixed to handle simple arrays.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

[ Permlink | « Hide ]

Patrick Linskey added a comment - 01/Mar/07 01:22 AM

What happens if openjpa.DynamicDataStructs is enabled?

Patrick Linskey made changes - 01/Mar/07 01:22 AM

Field	Original Value	New Value
Fix Version/s		0.9.7 [ 12312340 ]

Patrick Linskey made changes - 08/Mar/07 09:34 AM

Status	Open [ 1 ]	Resolved [ 5 ]
Resolution		Fixed [ 1 ]
Fix Version/s	0.9.7 [ 12312340 ]

[ Permlink | « Hide ]

Patrick Linskey added a comment - 08/Mar/07 09:34 AM

Resolved. I changed AbstractPCData to not marshal / unmarshal arrays via Lists, but I did not do any memory footprint measurement.

Repository	Revision	Date	User	Message
ASF	#515987	Thu Mar 08 09:34:52 UTC 2007	pcl	~~OPENJPA-71~~: resolved inefficiency with array types and AbstractPCData
				Files Changed
				ADD /incubator/openjpa/trunk/openjpa-persistence-jdbc/src/test/java/org/apache/openjpa/persistence/datacache/TestArrayFieldsInDataCache.java MODIFY /incubator/openjpa/trunk/openjpa-kernel/src/main/java/org/apache/openjpa/kernel/AbstractPCData.java MODIFY /incubator/openjpa/trunk/openjpa-persistence-jdbc/src/test/java/org/apache/openjpa/persistence/test/SingleEMTest.java MODIFY /incubator/openjpa/trunk/openjpa-persistence-jdbc/src/test/java/org/apache/openjpa/persistence/simple/AllFieldTypes.java MODIFY /incubator/openjpa/trunk/openjpa-persistence/src/main/java/org/apache/openjpa/persistence/PersistentCollection.java

Patrick Linskey made changes - 09/Mar/07 11:11 AM

Affects Version/s		0.9.0 [ 12312343 ]
Affects Version/s		0.9.6 [ 12312342 ]
Fix Version/s		0.9.7 [ 12312340 ]