Ivy
  1. Ivy
  2. IVY-1197

OutOfMemoryError during ivy:publish

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0
    • Fix Version/s: None
    • Component/s: Core
    • Labels:
      None

      Description

      When publishing a large file, an OutOfMemoryError occurs.

      [ivy:publish] 	published ppg to XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      
      BUILD FAILED
      /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: The following error occurred while executing this line:
      /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: java.lang.OutOfMemoryError: Java heap space
      	at java.util.Arrays.copyOf(Arrays.java:2786)
      	at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
      	at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61)
      	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168)
      	at org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200)
      	at org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82)
      	at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140)
      	at org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85)
      	at org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130)
      	at org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219)
      	at org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261)
      	at org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170)
      	at org.apache.ivy.Ivy.publish(Ivy.java:600)
      	at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299)
      	at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
      	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
      	at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
      	at org.apache.tools.ant.Task.perform(Task.java:348)
      	at org.apache.tools.ant.Target.execute(Target.java:390)
      	at org.apache.tools.ant.Target.performTasks(Target.java:411)
      	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
      	at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
      	at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
      	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
      	at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
      	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      
      Total time: 14 minutes 24 seconds
      Finished: FAILURE
      

      The size of the file that is being uploaded is: 687712714, so around 650-700MB.

      The publish task is part of a Hudson Ant build where the artefacts are published to an Artifactory repository at the end.
      I have given the Job 1300MB for the max heap size.

      It seems as if the whole file is loaded into memory for the upload.

      1. org.apache.ivy.util.url.HttpClientHandler.patch
        0.8 kB
        Loren Kratzke
      2. ivylarge.zip
        6 kB
        Loren Kratzke
      3. ASF.LICENSE.NOT.GRANTED--clipboard.txt
        5 kB
        Torkild U. Resheim

        Issue Links

          Activity

          Michael Rumpf created issue -
          Torkild U. Resheim made changes -
          Field Original Value New Value
          Attachment clipboard.txt [ 12454208 ]
          Martin Todorov made changes -
          Link This issue is related to IVY-1411 [ IVY-1411 ]
          Loren Kratzke made changes -
          Attachment org.apache.ivy.util.url.HttpClientHandler.patch [ 12638690 ]
          Loren Kratzke made changes -
          Loren Kratzke made changes -
          Attachment org.apache.ivy.util.url.HttpClientHandler.patch [ 12638690 ]
          Antoine Levy-Lambert made changes -
          Summary OutOfMemoryError duriong ivy:publish OutOfMemoryError during ivy:publish
          Loren Kratzke made changes -
          Attachment ivylarge.zip [ 12723940 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Michael Rumpf
            • Votes:
              5 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:

                Development