Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3817

bin/mapred command cannot run distcp and archive jobs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.0.0-alpha
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    1. MAPREDUCE-3817.patch
      1 kB
      Arun C Murthy
    2. MAPREDUCE-3817.patch
      1 kB
      Arpit Gupta

      Activity

      Transition Time In Source Status Execution Times Last Executer Last Execution Date
      Open Open Patch Available Patch Available
      40m 14s 1 Mahadev konar 06/Feb/12 18:46
      Patch Available Patch Available Open Open
      7h 1 Arun C Murthy 07/Feb/12 01:47
      Open Open Resolved Resolved
      3m 33s 1 Arun C Murthy 07/Feb/12 01:50
      Resolved Resolved Closed Closed
      27d 58m 1 Arun C Murthy 05/Mar/12 02:49
      Allen Wittenauer made changes -
      Affects Version/s 2.0.0-alpha [ 12320354 ]
      Affects Version/s 0.24.0 [ 12317654 ]
      Arun C Murthy made changes -
      Status Resolved [ 5 ] Closed [ 6 ]
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-trunk #982 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/982/)
      MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #982 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/982/ ) MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-0.23-Build #184 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/184/)
      Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #184 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/184/ ) Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-0.23-Build #162 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/162/)
      Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #162 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/162/ ) Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk #949 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/949/)
      MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #949 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/949/ ) MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-0.23-Commit #514 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/514/)
      Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #514 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/514/ ) Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-trunk-Commit #1692 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1692/)
      MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1692 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1692/ ) MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Common-0.23-Commit #506 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/506/)
      Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #506 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/506/ ) Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Common-trunk-Commit #1679 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1679/)
      MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1679 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1679/ ) MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk-Commit #1752 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1752/)
      MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1752 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1752/ ) MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241323 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-0.23-Commit #496 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/496/)
      Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.

      acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #496 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/496/ ) Merge -c 1241323 from trunk to branch-0.23 to fix MAPREDUCE-3817 . Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241324 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
      Arun C Murthy made changes -
      Status Open [ 1 ] Resolved [ 5 ]
      Fix Version/s 0.23.1 [ 12318883 ]
      Resolution Fixed [ 1 ]
      Hide
      Arun C Murthy added a comment -

      I just committed this. Thanks Arpit!

      Show
      Arun C Murthy added a comment - I just committed this. Thanks Arpit!
      Arun C Murthy made changes -
      Attachment MAPREDUCE-3817.patch [ 12513553 ]
      Hide
      Arun C Murthy added a comment -

      Rebased on trunk.

      Show
      Arun C Murthy added a comment - Rebased on trunk.
      Arun C Murthy made changes -
      Status Patch Available [ 10002 ] Open [ 1 ]
      Hide
      Arpit Gupta added a comment -

      no tests added as changes are to shell scripts. Ran distcp and archive jobs using bin/mapred with these changes successfully.

      Show
      Arpit Gupta added a comment - no tests added as changes are to shell scripts. Ran distcp and archive jobs using bin/mapred with these changes successfully.
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12513459/MAPREDUCE-3817.patch
      against trunk revision .

      +1 @author. The patch does not contain any @author tags.

      -1 tests included. The patch doesn't appear to include any new or modified tests.
      Please justify why no new tests are needed for this patch.
      Also please list what manual steps were performed to verify this patch.

      +1 javadoc. The javadoc tool did not generate any warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 eclipse:eclipse. The patch built with eclipse:eclipse.

      +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      +1 core tests. The patch passed unit tests in .

      +1 contrib tests. The patch passed contrib unit tests.

      Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1789//testReport/
      Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1789//console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12513459/MAPREDUCE-3817.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1789//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1789//console This message is automatically generated.
      Mahadev konar made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Mahadev konar made changes -
      Component/s mrv2 [ 12314301 ]
      Arpit Gupta made changes -
      Field Original Value New Value
      Attachment MAPREDUCE-3817.patch [ 12513459 ]
      Hide
      Arpit Gupta added a comment -

      added same options available in bin/hadoop also to bin/mapred for distcp and archives

      Show
      Arpit Gupta added a comment - added same options available in bin/hadoop also to bin/mapred for distcp and archives
      Arpit Gupta created issue -

        People

        • Assignee:
          Arpit Gupta
          Reporter:
          Arpit Gupta
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development