Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.1.0
    • Fix Version/s: notrack
    • Component/s: Build
    • Labels:
      None

      Description

      Jenkins builds are failing due to maven memory issue.

        Issue Links

          Activity

          Arvind Prabhakar made changes -
          Fix Version/s notrack [ 12320245 ]
          Brock Noland made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Brock Noland added a comment -

          FLUME-984 fixed this, I ran a build manually and then re-enabled the project, after having renamed it to flume-trunk.

          Show
          Brock Noland added a comment - FLUME-984 fixed this, I ran a build manually and then re-enabled the project, after having renamed it to flume-trunk.
          Brock Noland made changes -
          Assignee Arvind Prabhakar [ aprabhakar ] Brock Noland [ brocknoland ]
          Brock Noland made changes -
          Link This issue is blocked by FLUME-984 [ FLUME-984 ]
          Brock Noland made changes -
          Affects Version/s v1.1.0 [ 12319284 ]
          Component/s Build [ 12315318 ]
          Hide
          Brock Noland added a comment -

          400KB with FLUME-982

          [noland@localhost flume-728]$ ls -lh flume-ng-node/target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt
          rw-rw-r- 1 noland noland 368K Feb 21 09:39 flume-ng-node/target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt

          Show
          Brock Noland added a comment - 400KB with FLUME-982 [noland@localhost flume-728] $ ls -lh flume-ng-node/target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt rw-rw-r - 1 noland noland 368K Feb 21 09:39 flume-ng-node/target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt
          Hide
          Brock Noland added a comment -

          In TestDefaultLogicalNodeManager.testErrorNode, PollableSournceRunner generates about 175MB of errors causing mavent o OOM.

          Show
          Brock Noland added a comment - In TestDefaultLogicalNodeManager.testErrorNode, PollableSournceRunner generates about 175MB of errors causing mavent o OOM.
          Brock Noland made changes -
          Field Original Value New Value
          Link This issue is blocked by FLUME-982 [ FLUME-982 ]
          Hide
          Brock Noland added a comment -

          Looks like we could add memory or log less data in this test:

          [noland@localhost flume-ng-node]$ ls -lh target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt
          -rw-rw-r-- 1 noland noland 175M Feb 21 09:17 target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt
          
          Show
          Brock Noland added a comment - Looks like we could add memory or log less data in this test: [noland@localhost flume-ng-node]$ ls -lh target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt -rw-rw-r-- 1 noland noland 175M Feb 21 09:17 target/surefire-reports/org.apache.flume.node.TestDefaultLogicalNodeManager-output.txt
          Hide
          Brock Noland added a comment -

          One example below:

          ------------------------------------------------------
           T E S T S
          -------------------------------------------------------
          Running org.apache.flume.conf.properties.TestPropertiesFileConfigurationProvider
          Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.147 sec
          Running org.apache.flume.node.TestDefaultLogicalNodeManager
          Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.08 sec
          Running org.apache.flume.node.TestFlumeNode
          Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.061 sec
          Running org.apache.flume.node.TestFlumeNodeApplication
          Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 sec
          Running org.apache.flume.node.TestAbstractLogicalNodeManager
          Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.2 sec
          Running org.apache.flume.source.TestNetcatSource
          Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.225 sec
          
          Results :
          
          Tests run: 12, Failures: 0, Errors: 0, Skipped: 3
          
          [JENKINS] Recording test results
          mavenExecutionResult exceptions not empty
          message : Java heap space
          Stack trace :
          java.lang.OutOfMemoryError: Java heap space
                 at java.util.Arrays.copyOf(Arrays.java:2882)
                 at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
                 at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:515)
                 at java.lang.StringBuffer.append(StringBuffer.java:306)
                 at java.io.StringWriter.write(StringWriter.java:77)
                 at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1129)
                 at org.apache.commons.io.IOUtils.copy(IOUtils.java:1104)
                 at org.apache.commons.io.IOUtils.copy(IOUtils.java:1050)
                 at org.apache.commons.io.IOUtils.copy(IOUtils.java:1075)
                 at org.apache.commons.io.IOUtils.toString(IOUtils.java:382)
                 at org.apache.commons.io.FileUtils.readFileToString(FileUtils.java:1103)
                 at org.apache.commons.io.FileUtils.readFileToString(FileUtils.java:1120)
                 at hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:195)
                 at hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:130)
                 at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:115)
                 at hudson.tasks.junit.TestResult.parse(TestResult.java:208)
                 at hudson.tasks.junit.TestResult.parse(TestResult.java:163)
                 at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:139)
                 at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoSucceeded(Maven3Builder.java:478)
                 at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:459)
                 at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87)
                 at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42)
                 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228)
                 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
                 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
                 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
                 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
                 at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
                 at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
                 at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
                 at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
                 at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
          channel stopped
          
          Show
          Brock Noland added a comment - One example below: ------------------------------------------------------ T E S T S ------------------------------------------------------- Running org.apache.flume.conf.properties.TestPropertiesFileConfigurationProvider Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.147 sec Running org.apache.flume.node.TestDefaultLogicalNodeManager Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.08 sec Running org.apache.flume.node.TestFlumeNode Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.061 sec Running org.apache.flume.node.TestFlumeNodeApplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 sec Running org.apache.flume.node.TestAbstractLogicalNodeManager Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.2 sec Running org.apache.flume.source.TestNetcatSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.225 sec Results : Tests run: 12, Failures: 0, Errors: 0, Skipped: 3 [JENKINS] Recording test results mavenExecutionResult exceptions not empty message : Java heap space Stack trace : java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2882) at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100) at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:515) at java.lang.StringBuffer.append(StringBuffer.java:306) at java.io.StringWriter.write(StringWriter.java:77) at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1129) at org.apache.commons.io.IOUtils.copy(IOUtils.java:1104) at org.apache.commons.io.IOUtils.copy(IOUtils.java:1050) at org.apache.commons.io.IOUtils.copy(IOUtils.java:1075) at org.apache.commons.io.IOUtils.toString(IOUtils.java:382) at org.apache.commons.io.FileUtils.readFileToString(FileUtils.java:1103) at org.apache.commons.io.FileUtils.readFileToString(FileUtils.java:1120) at hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:195) at hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:130) at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:115) at hudson.tasks.junit.TestResult.parse(TestResult.java:208) at hudson.tasks.junit.TestResult.parse(TestResult.java:163) at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:139) at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoSucceeded(Maven3Builder.java:478) at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:459) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) channel stopped
          Brock Noland created issue -

            People

            • Assignee:
              Brock Noland
              Reporter:
              Brock Noland
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development