Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3368 [Umbrella] YARN web UI: Next generation
  3. YARN-5682

[YARN-3368] Fix maven build to keep all generated or downloaded files in target folder

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Activity

      Hide
      leftnoteasy Wangda Tan added a comment -

      Attached ver.1 patch, tested locally, runs fine to me

      + Sunil G.

      Show
      leftnoteasy Wangda Tan added a comment - Attached ver.1 patch, tested locally, runs fine to me + Sunil G .
      Hide
      hadoopqa Hadoop QA added a comment -
      -1 overall



      Vote Subsystem Runtime Comment
      0 reexec 3m 58s Docker mode activated.
      +1 @author 0m 0s The patch does not contain any @author tags.
      -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
      0 mvndep 5m 9s Maven dependency ordering for branch
      +1 mvninstall 7m 45s YARN-3368 passed
      +1 compile 2m 20s YARN-3368 passed
      +1 mvnsite 3m 9s YARN-3368 passed
      +1 mvneclipse 0m 42s YARN-3368 passed
      +1 javadoc 1m 33s YARN-3368 passed
      0 mvndep 0m 9s Maven dependency ordering for patch
      +1 mvninstall 2m 24s the patch passed
      +1 compile 2m 15s the patch passed
      +1 javac 2m 15s the patch passed
      +1 mvnsite 3m 4s the patch passed
      +1 mvneclipse 0m 36s the patch passed
      +1 whitespace 0m 0s The patch has no whitespace issues.
      +1 xml 0m 3s The patch has no ill-formed XML file.
      +1 javadoc 1m 29s the patch passed
      -1 unit 23m 25s hadoop-yarn in the patch failed.
      +1 unit 0m 7s hadoop-yarn-ui in the patch passed.
      +1 asflicense 0m 18s The patch does not generate ASF License warnings.
      59m 4s



      Reason Tests
      Failed junit tests hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer
        hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices
        hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager



      Subsystem Report/Notes
      Docker Image:yetus/hadoop:9baccb9
      JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830637/YARN-5682-YARN-3368.001.patch
      JIRA Issue YARN-5682
      Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
      uname Linux a6bb981b5b67 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
      Build tool maven
      Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
      git revision YARN-3368 / 9ef8291
      Default Java 1.8.0_101
      unit https://builds.apache.org/job/PreCommit-YARN-Build/13234/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
      unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13234/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
      Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13234/testReport/
      modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn
      Console output https://builds.apache.org/job/PreCommit-YARN-Build/13234/console
      Powered by Apache Yetus 0.3.0 http://yetus.apache.org

      This message was automatically generated.

      Show
      hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 3m 58s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 5m 9s Maven dependency ordering for branch +1 mvninstall 7m 45s YARN-3368 passed +1 compile 2m 20s YARN-3368 passed +1 mvnsite 3m 9s YARN-3368 passed +1 mvneclipse 0m 42s YARN-3368 passed +1 javadoc 1m 33s YARN-3368 passed 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 2m 24s the patch passed +1 compile 2m 15s the patch passed +1 javac 2m 15s the patch passed +1 mvnsite 3m 4s the patch passed +1 mvneclipse 0m 36s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 3s The patch has no ill-formed XML file. +1 javadoc 1m 29s the patch passed -1 unit 23m 25s hadoop-yarn in the patch failed. +1 unit 0m 7s hadoop-yarn-ui in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 59m 4s Reason Tests Failed junit tests hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices   hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager Subsystem Report/Notes Docker Image:yetus/hadoop:9baccb9 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830637/YARN-5682-YARN-3368.001.patch JIRA Issue YARN-5682 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux a6bb981b5b67 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision YARN-3368 / 9ef8291 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-YARN-Build/13234/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13234/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13234/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/13234/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
      Hide
      sunilg Sunil G added a comment -

      Hi Tan, Wangda

      I ran mvn install -Pyarn-ui with and w/o mvn clean after applying this patch. i think we are taking more time now.

      mvn clean; mvn install -Pyarn-ui
      [INFO] Apache Hadoop YARN UI .............................. SUCCESS [01:56 min]
      
      mvn install -Pyarn-ui
      [INFO] Apache Hadoop YARN UI .............................. SUCCESS [01:51 min]
      

      I tested mvn install -Pyarn-ui w/o this patch. It is taking lesser time.
      I think we need not have to clean temp dir's.

      [INFO] Total time: 29.515 s
      
      Show
      sunilg Sunil G added a comment - Hi Tan, Wangda I ran mvn install -Pyarn-ui with and w/o mvn clean after applying this patch. i think we are taking more time now. mvn clean; mvn install -Pyarn-ui [INFO] Apache Hadoop YARN UI .............................. SUCCESS [01:56 min] mvn install -Pyarn-ui [INFO] Apache Hadoop YARN UI .............................. SUCCESS [01:51 min] I tested mvn install -Pyarn-ui w/o this patch. It is taking lesser time. I think we need not have to clean temp dir's. [INFO] Total time: 29.515 s
      Hide
      leftnoteasy Wangda Tan added a comment -

      Added ver.2 patch, now mvn install without clean can be done in 30 secs.

      Sunil G, mind to review again? Thanks.

      Show
      leftnoteasy Wangda Tan added a comment - Added ver.2 patch, now mvn install without clean can be done in 30 secs. Sunil G , mind to review again? Thanks.
      Hide
      sunilg Sunil G added a comment -

      Thanks Wangda Tan for the latest patch.. Builds seem fine for me.

      [INFO] Apache Hadoop YARN UI .............................. SUCCESS [ 34.506 s]
      

      +1

      I will commit the patch if there are no objections later today..

      Show
      sunilg Sunil G added a comment - Thanks Wangda Tan for the latest patch.. Builds seem fine for me. [INFO] Apache Hadoop YARN UI .............................. SUCCESS [ 34.506 s] +1 I will commit the patch if there are no objections later today..
      Hide
      hadoopqa Hadoop QA added a comment -
      -1 overall



      Vote Subsystem Runtime Comment
      0 reexec 4m 45s Docker mode activated.
      +1 @author 0m 0s The patch does not contain any @author tags.
      -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
      0 mvndep 3m 54s Maven dependency ordering for branch
      +1 mvninstall 8m 2s YARN-3368 passed
      +1 compile 2m 16s YARN-3368 passed
      +1 mvnsite 3m 8s YARN-3368 passed
      +1 mvneclipse 0m 41s YARN-3368 passed
      +1 javadoc 1m 31s YARN-3368 passed
      0 mvndep 0m 9s Maven dependency ordering for patch
      +1 mvninstall 2m 25s the patch passed
      +1 compile 2m 15s the patch passed
      +1 javac 2m 15s the patch passed
      +1 mvnsite 3m 3s the patch passed
      +1 mvneclipse 0m 36s the patch passed
      +1 whitespace 0m 0s The patch has no whitespace issues.
      +1 xml 0m 2s The patch has no ill-formed XML file.
      +1 javadoc 1m 28s the patch passed
      -1 unit 19m 20s hadoop-yarn in the patch failed.
      +1 unit 0m 8s hadoop-yarn-ui in the patch passed.
      +1 asflicense 0m 19s The patch does not generate ASF License warnings.
      54m 42s



      Reason Tests
      Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



      Subsystem Report/Notes
      Docker Image:yetus/hadoop:9baccb9
      JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12831466/YARN-5682-YARN-3368.002.patch
      JIRA Issue YARN-5682
      Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
      uname Linux 024b0f8b74ec 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
      Build tool maven
      Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
      git revision YARN-3368 / 9ef8291
      Default Java 1.8.0_101
      unit https://builds.apache.org/job/PreCommit-YARN-Build/13274/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
      unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13274/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
      Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13274/testReport/
      modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn
      Console output https://builds.apache.org/job/PreCommit-YARN-Build/13274/console
      Powered by Apache Yetus 0.3.0 http://yetus.apache.org

      This message was automatically generated.

      Show
      hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 4m 45s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 3m 54s Maven dependency ordering for branch +1 mvninstall 8m 2s YARN-3368 passed +1 compile 2m 16s YARN-3368 passed +1 mvnsite 3m 8s YARN-3368 passed +1 mvneclipse 0m 41s YARN-3368 passed +1 javadoc 1m 31s YARN-3368 passed 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 2m 25s the patch passed +1 compile 2m 15s the patch passed +1 javac 2m 15s the patch passed +1 mvnsite 3m 3s the patch passed +1 mvneclipse 0m 36s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 javadoc 1m 28s the patch passed -1 unit 19m 20s hadoop-yarn in the patch failed. +1 unit 0m 8s hadoop-yarn-ui in the patch passed. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 54m 42s Reason Tests Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9baccb9 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12831466/YARN-5682-YARN-3368.002.patch JIRA Issue YARN-5682 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux 024b0f8b74ec 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision YARN-3368 / 9ef8291 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-YARN-Build/13274/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13274/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13274/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/13274/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
      Hide
      sunilg Sunil G added a comment -

      No tests are needed for this pom file changes. Hence test failures/no tests can be accepted.

      Show
      sunilg Sunil G added a comment - No tests are needed for this pom file changes. Hence test failures/no tests can be accepted.
      Hide
      sunilg Sunil G added a comment -

      Thanks Wangda Tan. Committed to YARN-3368 branch!

      Show
      sunilg Sunil G added a comment - Thanks Wangda Tan . Committed to YARN-3368 branch!
      Hide
      hudson Hudson added a comment -

      SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10778 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10778/)
      YARN-5682. YARN-3368 Fix maven build to keep all generated or (wangda: rev 98b2ad7208eaadc205afd96cc002e5650128da4d)

      • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml
      • (edit) hadoop-yarn-project/hadoop-yarn/pom.xml
      Show
      hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10778 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10778/ ) YARN-5682 . YARN-3368 Fix maven build to keep all generated or (wangda: rev 98b2ad7208eaadc205afd96cc002e5650128da4d) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml (edit) hadoop-yarn-project/hadoop-yarn/pom.xml

        People

        • Assignee:
          leftnoteasy Wangda Tan
          Reporter:
          leftnoteasy Wangda Tan
        • Votes:
          0 Vote for this issue
          Watchers:
          4 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development