[IVY-1197] OutOfMemoryError during ivy:publish

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0
• Component/s: Core
• Assignee: Unassigned
• Reporter: Michael Rumpf
• Created: 16/Jun/10 15:16
• Updated: 19/Oct/22 21:47

Description

When publishing a large file, an OutOfMemoryError occurs.

[ivy:publish] 	published ppg to XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

BUILD FAILED
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: The following error occurred while executing this line:
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: java.lang.OutOfMemoryError: Java heap space
	at java.util.Arrays.copyOf(Arrays.java:2786)
	at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
	at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61)
	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168)
	at org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200)
	at org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82)
	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140)
	at org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85)
	at org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130)
	at org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219)
	at org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209)
	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282)
	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261)
	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170)
	at org.apache.ivy.Ivy.publish(Ivy.java:600)
	at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299)
	at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.Target.execute(Target.java:390)
	at org.apache.tools.ant.Target.performTasks(Target.java:411)
	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
	at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
	at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
	at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Total time: 14 minutes 24 seconds
Finished: FAILURE

The size of the file that is being uploaded is: 687712714, so around 650-700MB.

The publish task is part of a Hudson Ant build where the artefacts are published to an Artifactory repository at the end.
I have given the Job 1300MB for the max heap size.

It seems as if the whole file is loaded into memory for the upload.

Issue Links

• is related to: IVY-1411 Make the progress bar a bit more reasonable