Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: build
    • Labels:
      None
    • Environment:

      Java 6, RHEL 5.5

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Created rpm and debian packages for MapReduce.

      Description

      This jira is corresponding to HADOOP-6255 and associated directory layout change. The patch for creating Mapreduce rpm packaging should be posted here for patch test build to verify against mapreduce svn trunk.

      1. MAPREDUCE-2521-7.patch
        129 kB
        Eric Yang
      2. MAPREDUCE-2521-6.patch
        129 kB
        Eric Yang
      3. MAPREDUCE-2521-5.patch
        127 kB
        Eric Yang
      4. MAPREDUCE-2521-4.patch
        127 kB
        Eric Yang
      5. MAPREDUCE-2521-3.patch
        126 kB
        Eric Yang
      6. MAPREDUCE-2521-2.patch
        126 kB
        Eric Yang
      7. MAPREDUCE-2521-1.patch
        126 kB
        Eric Yang
      8. MAPREDUCE-2521.patch
        125 kB
        Eric Yang

        Issue Links

          Activity

          Hide
          Eric Yang added a comment -

          Usage:

          ant rpm

          Show
          Eric Yang added a comment - Usage: ant rpm
          Hide
          Eric Yang added a comment -

          Store config templates in $PREFIX/share/hadoop/templates, and change related script to use the new location.

          Show
          Eric Yang added a comment - Store config templates in $PREFIX/share/hadoop/templates, and change related script to use the new location.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12479850/HADOOP-6255-mapred-trunk-2.patch
          against trunk revision 1125082.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 15 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/279//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12479850/HADOOP-6255-mapred-trunk-2.patch against trunk revision 1125082. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 15 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/279//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Attach correct patch.

          Show
          Eric Yang added a comment - Attach correct patch.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12479823/MAPREDUCE-2521.patch
          against trunk revision 1125082.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 15 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12479823/MAPREDUCE-2521.patch against trunk revision 1125082. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 15 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/278//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Package librecordio to lib.

          Show
          Eric Yang added a comment - Package librecordio to lib.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12479855/MAPREDUCE-2521-1.patch
          against trunk revision 1125148.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 15 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12479855/MAPREDUCE-2521-1.patch against trunk revision 1125148. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 15 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/280//console This message is automatically generated.
          Hide
          Eric Yang added a comment -
          • Exclude local copy of configuration.xsl and hadoop-metrics2.properties from MAPREDUCE project.
          Show
          Eric Yang added a comment - Exclude local copy of configuration.xsl and hadoop-metrics2.properties from MAPREDUCE project.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12479857/MAPREDUCE-2521-2.patch
          against trunk revision 1125148.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          -1 core tests. The patch failed these core unit tests:
          org.apache.hadoop.mapred.TestJobQueueInformation

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12479857/MAPREDUCE-2521-2.patch against trunk revision 1125148. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). -1 core tests. The patch failed these core unit tests: org.apache.hadoop.mapred.TestJobQueueInformation +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/281//console This message is automatically generated.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12479873/MAPREDUCE-2521-3.patch
          against trunk revision 1125148.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12479873/MAPREDUCE-2521-3.patch against trunk revision 1125148. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/282//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Change configuration directory from $PREFIX/conf to $PREFIX/etc/hadoop per Owen's recommendation. For RPM/deb, it will use /etc/hadoop as default, and create symlink for $PREFIX/etc/hadoop point to /etc/hadoop.

          Show
          Eric Yang added a comment - Change configuration directory from $PREFIX/conf to $PREFIX/etc/hadoop per Owen's recommendation. For RPM/deb, it will use /etc/hadoop as default, and create symlink for $PREFIX/etc/hadoop point to /etc/hadoop.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12480179/MAPREDUCE-2521-4.patch
          against trunk revision 1126801.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12480179/MAPREDUCE-2521-4.patch against trunk revision 1126801. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/299//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Include example, test, and tool jar files in bin-package target.

          Show
          Eric Yang added a comment - Include example, test, and tool jar files in bin-package target.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12480327/MAPREDUCE-2521-5.patch
          against trunk revision 1126801.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings).

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//testReport/
          Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12480327/MAPREDUCE-2521-5.patch against trunk revision 1126801. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 4 release audit warnings (more than the trunk's current 2 warnings). +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//testReport/ Release audit warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/303//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Make sure webapps directory is bundled and class path reference is corrected.

          Show
          Eric Yang added a comment - Make sure webapps directory is bundled and class path reference is corrected.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12480477/MAPREDUCE-2521-6.patch
          against trunk revision 1127444.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these core unit tests:
          org.apache.hadoop.cli.TestMRCLI

          +1 contrib tests. The patch passed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//testReport/
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12480477/MAPREDUCE-2521-6.patch against trunk revision 1127444. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these core unit tests: org.apache.hadoop.cli.TestMRCLI +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//testReport/ Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/304//console This message is automatically generated.
          Hide
          Eric Yang added a comment -

          Minor bug fixes:

          • Removed *.debian and *.redhat script from /usr/sbin
          • Renamed package from hadoop-mapred to hadoop-mapreduce
          • Renamed dependency from hadoop to hadoop-common
          Show
          Eric Yang added a comment - Minor bug fixes: Removed *.debian and *.redhat script from /usr/sbin Renamed package from hadoop-mapred to hadoop-mapreduce Renamed dependency from hadoop to hadoop-common
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12480596/MAPREDUCE-2521-7.patch
          against trunk revision 1127444.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 16 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these core unit tests:
          org.apache.hadoop.cli.TestMRCLI

          -1 contrib tests. The patch failed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//testReport/
          Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12480596/MAPREDUCE-2521-7.patch against trunk revision 1127444. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 16 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these core unit tests: org.apache.hadoop.cli.TestMRCLI -1 contrib tests. The patch failed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//testReport/ Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/312//console This message is automatically generated.
          Hide
          Owen O'Malley added a comment -

          I just committed this. Thanks, Eric!

          Show
          Owen O'Malley added a comment - I just committed this. Thanks, Eric!
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #705 (See https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/705/)
          MAPREDUCE-2521. Create RPM and Debian packages for MapReduce. Changes
          deployment layout to be consistent across the binary tgz, rpm, and deb.
          (Eric Yang via omalley)

          omalley : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1128394
          Files :

          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/generateData.sh
          • /hadoop/mapreduce/trunk/bin/mapred
          • /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/fs/DFSCIOTest.java
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.large
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/control
          • /hadoop/mapreduce/trunk/src/contrib/mrunit/src/java/org/apache/hadoop/mrunit/package.html
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/prerm
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/rungridmix_2
          • /hadoop/mapreduce/trunk/src/packages/templates/conf/mapred-site.xml
          • /hadoop/mapreduce/trunk/src/packages/rpm/spec/hadoop-mapred.spec
          • /hadoop/mapreduce/trunk/src/packages/templates/conf
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/preinst
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.medium
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/README
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/gridmix-env
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.large
          • /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/pipes/Submitter.java
          • /hadoop/mapreduce/trunk/bin/start-mapred.sh
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml
          • /hadoop/mapreduce/trunk/src/packages/rpm
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.medium
          • /hadoop/mapreduce/trunk/src/contrib/raid/bin/stop-raidnode-remote.sh
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/postinst
          • /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/ReliabilityTest.java
          • /hadoop/mapreduce/trunk/src/packages/rpm/init.d/hadoop-tasktracker
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/generateGridmix2data.sh
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.large
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/rumen.xml
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.medium
          • /hadoop/mapreduce/trunk/src/packages/deb/init.d
          • /hadoop/mapreduce/trunk/src/contrib/fairscheduler/README
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.large
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.medium
          • /hadoop/mapreduce/trunk/src/packages/deb
          • /hadoop/mapreduce/trunk/src/packages/rpm/init.d/hadoop-jobtracker
          • /hadoop/mapreduce/trunk/src/packages/rpm/spec
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.small
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.medium
          • /hadoop/mapreduce/trunk/src/contrib/raid/bin/start-raidnode-remote.sh
          • /hadoop/mapreduce/trunk/src/packages/deb/init.d/hadoop-tasktracker
          • /hadoop/mapreduce/trunk/ivy.xml
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/README.gridmix2
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control
          • /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/LoadTypedBytes.java
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/maxent/maxent.large
          • /hadoop/mapreduce/trunk/src/c++/librecordio/test/Makefile
          • /hadoop/mapreduce/trunk/src/packages
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml
          • /hadoop/mapreduce/trunk/CHANGES.txt
          • /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
          • /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/HadoopStreaming.java
          • /hadoop/mapreduce/trunk/src/examples/python/pyAbacus/compile
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.small
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.medium
          • /hadoop/mapreduce/trunk/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh
          • /hadoop/mapreduce/trunk/src/contrib/block_forensics/client/BlockForensics.java
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.small
          • /hadoop/mapreduce/trunk/src/contrib/raid/README
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/streaming.xml
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/postrm
          • /hadoop/mapreduce/trunk/src/test/system/conf/system-test-mapred.xml
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/capacity_scheduler.xml
          • /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/conffile
          • /hadoop/mapreduce/trunk/src/packages/deb/init.d/hadoop-jobtracker
          • /hadoop/mapreduce/trunk/src/packages/update-mapred-env.sh
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.small
          • /hadoop/mapreduce/trunk/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/postexdiagnosis/PostExPerformanceDiagnoser.java
          • /hadoop/mapreduce/trunk/src/contrib/mumak/bin/mumak.sh
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.large
          • /hadoop/mapreduce/trunk/src/packages/templates
          • /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
          • /hadoop/mapreduce/trunk/src/contrib/data_join/src/examples/org/apache/hadoop/contrib/utils/join/README.txt
          • /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/DumpTypedBytes.java
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.small
          • /hadoop/mapreduce/trunk/bin/stop-mapred.sh
          • /hadoop/mapreduce/trunk/ivy/libraries.properties
          • /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/vaidya.xml
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/gridmix-env-2
          • /hadoop/mapreduce/trunk/bin/mapred-config.sh
          • /hadoop/mapreduce/trunk/build.xml
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.small
          • /hadoop/mapreduce/trunk/src/examples/python/compile
          • /hadoop/mapreduce/trunk/src/packages/rpm/init.d
          • /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.large
          • /hadoop/mapreduce/trunk/src/c++/pipes/debug/pipes-default-script
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #705 (See https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/705/ ) MAPREDUCE-2521 . Create RPM and Debian packages for MapReduce. Changes deployment layout to be consistent across the binary tgz, rpm, and deb. (Eric Yang via omalley) omalley : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1128394 Files : /hadoop/mapreduce/trunk/src/benchmarks/gridmix/generateData.sh /hadoop/mapreduce/trunk/bin/mapred /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/fs/DFSCIOTest.java /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.large /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/control /hadoop/mapreduce/trunk/src/contrib/mrunit/src/java/org/apache/hadoop/mrunit/package.html /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/prerm /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/rungridmix_2 /hadoop/mapreduce/trunk/src/packages/templates/conf/mapred-site.xml /hadoop/mapreduce/trunk/src/packages/rpm/spec/hadoop-mapred.spec /hadoop/mapreduce/trunk/src/packages/templates/conf /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/preinst /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.medium /hadoop/mapreduce/trunk/src/benchmarks/gridmix/README /hadoop/mapreduce/trunk/src/benchmarks/gridmix/gridmix-env /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.large /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/pipes/Submitter.java /hadoop/mapreduce/trunk/bin/start-mapred.sh /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml /hadoop/mapreduce/trunk/src/packages/rpm /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.medium /hadoop/mapreduce/trunk/src/contrib/raid/bin/stop-raidnode-remote.sh /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/postinst /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/ReliabilityTest.java /hadoop/mapreduce/trunk/src/packages/rpm/init.d/hadoop-tasktracker /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/generateGridmix2data.sh /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.large /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/rumen.xml /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.medium /hadoop/mapreduce/trunk/src/packages/deb/init.d /hadoop/mapreduce/trunk/src/contrib/fairscheduler/README /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.large /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.medium /hadoop/mapreduce/trunk/src/packages/deb /hadoop/mapreduce/trunk/src/packages/rpm/init.d/hadoop-jobtracker /hadoop/mapreduce/trunk/src/packages/rpm/spec /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.small /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.medium /hadoop/mapreduce/trunk/src/contrib/raid/bin/start-raidnode-remote.sh /hadoop/mapreduce/trunk/src/packages/deb/init.d/hadoop-tasktracker /hadoop/mapreduce/trunk/ivy.xml /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/README.gridmix2 /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/LoadTypedBytes.java /hadoop/mapreduce/trunk/src/benchmarks/gridmix/maxent/maxent.large /hadoop/mapreduce/trunk/src/c++/librecordio/test/Makefile /hadoop/mapreduce/trunk/src/packages /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml /hadoop/mapreduce/trunk/CHANGES.txt /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/LinuxTaskController.java /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/HadoopStreaming.java /hadoop/mapreduce/trunk/src/examples/python/pyAbacus/compile /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.small /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.medium /hadoop/mapreduce/trunk/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh /hadoop/mapreduce/trunk/src/contrib/block_forensics/client/BlockForensics.java /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatasort/webdata_sort.small /hadoop/mapreduce/trunk/src/contrib/raid/README /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/streaming.xml /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/postrm /hadoop/mapreduce/trunk/src/test/system/conf/system-test-mapred.xml /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/capacity_scheduler.xml /hadoop/mapreduce/trunk/src/packages/deb/hadoop.control/conffile /hadoop/mapreduce/trunk/src/packages/deb/init.d/hadoop-jobtracker /hadoop/mapreduce/trunk/src/packages/update-mapred-env.sh /hadoop/mapreduce/trunk/src/benchmarks/gridmix/monsterQuery/monster_query.small /hadoop/mapreduce/trunk/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/postexdiagnosis/PostExPerformanceDiagnoser.java /hadoop/mapreduce/trunk/src/contrib/mumak/bin/mumak.sh /hadoop/mapreduce/trunk/src/benchmarks/gridmix/webdatascan/webdata_scan.large /hadoop/mapreduce/trunk/src/packages/templates /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java /hadoop/mapreduce/trunk/src/contrib/data_join/src/examples/org/apache/hadoop/contrib/utils/join/README.txt /hadoop/mapreduce/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/DumpTypedBytes.java /hadoop/mapreduce/trunk/src/benchmarks/gridmix/javasort/text-sort.small /hadoop/mapreduce/trunk/bin/stop-mapred.sh /hadoop/mapreduce/trunk/ivy/libraries.properties /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/vaidya.xml /hadoop/mapreduce/trunk/src/benchmarks/gridmix2/gridmix-env-2 /hadoop/mapreduce/trunk/bin/mapred-config.sh /hadoop/mapreduce/trunk/build.xml /hadoop/mapreduce/trunk/src/benchmarks/gridmix/pipesort/text-sort.small /hadoop/mapreduce/trunk/src/examples/python/compile /hadoop/mapreduce/trunk/src/packages/rpm/init.d /hadoop/mapreduce/trunk/src/benchmarks/gridmix/streamsort/text-sort.large /hadoop/mapreduce/trunk/src/c++/pipes/debug/pipes-default-script
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #694 (See https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk/694/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #694 (See https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk/694/ )
          Hide
          Amar Kamat added a comment -

          I cannot compile trunk after this commit. It fails with the error

          build.xml:1310: build/c++/<os-architecture>/include not found.
          

          The trunk compiles fine with this patch reverted.

          Show
          Amar Kamat added a comment - I cannot compile trunk after this commit. It fails with the error build.xml:1310: build/c++/<os-architecture>/include not found. The trunk compiles fine with this patch reverted.
          Hide
          Eric Yang added a comment -

          Amar, this is because -Dcompile.c++=true -Dcompile.native=true is not set. This is intentional to expose previously hidden bug where libraries may not have been packaged. It is also possible to add failOnError="false" on line 1310, and 1316 to package as it's previous state. If you feel strongly about this change, please open a JIRA. Thanks.

          Show
          Eric Yang added a comment - Amar, this is because -Dcompile.c++=true -Dcompile.native=true is not set. This is intentional to expose previously hidden bug where libraries may not have been packaged. It is also possible to add failOnError="false" on line 1310, and 1316 to package as it's previous state. If you feel strongly about this change, please open a JIRA. Thanks.
          Hide
          Eli Collins added a comment -

          Same issue as HDFS-2022, the binary target in the build should depend on the copmile-c++ target.

          Show
          Eli Collins added a comment - Same issue as HDFS-2022 , the binary target in the build should depend on the copmile-c++ target.
          Hide
          Amar Kamat added a comment -

          Eric,
          My concern is that when a new user checks out mapreduce trunk and does 'ant binary', the compilation should not fail. Also from the message its not clear as to what went wrong and whether its a user/framework issue.

          Show
          Amar Kamat added a comment - Eric, My concern is that when a new user checks out mapreduce trunk and does 'ant binary', the compilation should not fail. Also from the message its not clear as to what went wrong and whether its a user/framework issue.
          Hide
          Eric Yang added a comment -

          I will make binary target depends on compile-c++ targets in MAPREDUCE-2559. Thanks

          Show
          Eric Yang added a comment - I will make binary target depends on compile-c++ targets in MAPREDUCE-2559 . Thanks

            People

            • Assignee:
              Eric Yang
              Reporter:
              Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development