Ivy
  1. Ivy
  2. IVY-1197

OutOfMemoryError during ivy:publish

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0
    • Fix Version/s: None
    • Component/s: Core
    • Labels:
      None

      Description

      When publishing a large file, an OutOfMemoryError occurs.

      [ivy:publish] 	published ppg to XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      
      BUILD FAILED
      /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: The following error occurred while executing this line:
      /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: java.lang.OutOfMemoryError: Java heap space
      	at java.util.Arrays.copyOf(Arrays.java:2786)
      	at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
      	at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61)
      	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168)
      	at org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200)
      	at org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82)
      	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140)
      	at org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85)
      	at org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130)
      	at org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219)
      	at org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170)
      	at org.apache.ivy.Ivy.publish(Ivy.java:600)
      	at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299)
      	at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
      	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
      	at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
      	at org.apache.tools.ant.Task.perform(Task.java:348)
      	at org.apache.tools.ant.Target.execute(Target.java:390)
      	at org.apache.tools.ant.Target.performTasks(Target.java:411)
      	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
      	at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
      	at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
      	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
      	at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
      	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      
      Total time: 14 minutes 24 seconds
      Finished: FAILURE
      

      The size of the file that is being uploaded is: 687712714, so around 650-700MB.

      The publish task is part of a Hudson Ant build where the artefacts are published to an Artifactory repository at the end.
      I have given the Job 1300MB for the max heap size.

      It seems as if the whole file is loaded into memory for the upload.

      1. ASF.LICENSE.NOT.GRANTED--clipboard.txt
        5 kB
        Torkild U. Resheim
      2. ivylarge.zip
        6 kB
        Loren Kratzke
      3. org.apache.ivy.util.url.HttpClientHandler.patch
        0.8 kB
        Loren Kratzke

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Michael Rumpf
            • Votes:
              5 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:

                Development