Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3366

Mapreduce component should use consistent directory structure layout as HDFS/common

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
    • Environment:

      Java, Maven

    • Hadoop Flags:
      Reviewed

      Description

      Directory structure for MRv2 layout looks like:

      hadoop-mapreduce-0.23.0-SNAPSHOT/bin
                                      /conf
                                      /lib
                                      /modules
      

      The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.

      hadoop-mapreduce-0.23.0-SNAPSHOT/bin
                                      /etc/hadoop
                                      /lib
                                      /libexec
                                      /sbin
                                      /share/hadoop
                                      /share/hadoop/lib
      
      1. MAPREDUCE-3366.patch
        13 kB
        Eric Yang
      2. MAPREDUCE-3366-1-trunk.patch
        13 kB
        Eric Yang
      3. MAPREDUCE-3366-2-trunk.patch
        13 kB
        Eric Yang
      4. MAPREDUCE-3366-3-trunk.patch
        16 kB
        Eric Yang
      5. MAPREDUCE-3366-4-trunk.patch
        19 kB
        Eric Yang
      6. svn-rename-MAPREDUCE-3366-3.sh
        0.2 kB
        Eric Yang

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Open Open
          9d 3h 58m 3 Mahadev konar 07/Dec/11 02:06
          Open Open Patch Available Patch Available
          21d 8h 3m 4 Eric Yang 08/Dec/11 05:01
          Patch Available Patch Available Resolved Resolved
          8d 4h 15m 1 Mahadev konar 16/Dec/11 09:17
          Resolved Resolved Closed Closed
          79d 17h 31m 1 Arun C Murthy 05/Mar/12 02:49
          Gavin made changes -
          Link This issue is depended upon by HADOOP-7410 [ HADOOP-7410 ]
          Gavin made changes -
          Link This issue blocks HADOOP-7410 [ HADOOP-7410 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Eli Collins made changes -
          Fix Version/s 0.23.1 [ 12318883 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #934 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/934/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #934 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/934/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #114 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/114/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
          svn merge -c 1221533 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #114 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/114/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. svn merge -c 1221533 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #901 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/901/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #901 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/901/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #324 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/324/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
          svn merge -c 1221533 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #324 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/324/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. svn merge -c 1221533 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #302 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/302/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
          svn merge -c 1221533 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #302 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/302/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. svn merge -c 1221533 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1482 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1482/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1482 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1482/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #134 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/134/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
          svn merge -c 1221533 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #134 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/134/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. svn merge -c 1221533 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1533 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1533/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1533 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1533/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #313 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/313/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
          svn merge -c 1221533 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #313 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/313/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. svn merge -c 1221533 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1460 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1460/)
          MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1460 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1460/ ) MAPREDUCE-3588 . Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #929 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/929/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
          Files :

          • /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/trunk/hadoop-dist/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #929 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/929/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065 Files : /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-dist/pom.xml /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #896 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/896/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
          Files :

          • /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/trunk/hadoop-dist/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #896 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/896/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065 Files : /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-dist/pom.xml /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #129 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/129/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #129 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/129/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066 Files : /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #109 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/109/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #109 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/109/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066 Files : /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #310 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/310/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #310 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/310/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066 Files : /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1467 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1467/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
          Files :

          • /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/trunk/hadoop-dist/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1467 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1467/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065 Files : /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-dist/pom.xml /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #287 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/287/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #287 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/287/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066 Files : /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #298 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/298/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #298 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/298/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066 Files : /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1442 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1442/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
          Files :

          • /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/trunk/hadoop-dist/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1442 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1442/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065 Files : /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-dist/pom.xml /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1515 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1515/)
          MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
          Files :

          • /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
          • /hadoop/common/trunk/hadoop-dist/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
          • /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1515 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1515/ ) MAPREDUCE-3366 . Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065 Files : /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-dist/pom.xml /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
          Mahadev konar made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Hide
          Mahadev konar added a comment -

          I just committed this. Thanks Eric.

          Show
          Mahadev konar added a comment - I just committed this. Thanks Eric.
          Hide
          Mahadev konar added a comment -

          +1 the patch is good as it is. Committing it now.

          Show
          Mahadev konar added a comment - +1 the patch is good as it is. Committing it now.
          Hide
          Mahadev konar added a comment -

          @Eric P,
          The build procedure will still stay the same. Its just the structure of the tarball and the script locations will change.

          Show
          Mahadev konar added a comment - @Eric P, The build procedure will still stay the same. Its just the structure of the tarball and the script locations will change.
          Hide
          Eric Payne added a comment -

          @Mahadev,

          Are the build procedures changing as a result of this JIRA?

          Show
          Eric Payne added a comment - @Mahadev, Are the build procedures changing as a result of this JIRA?
          Hide
          Mahadev konar added a comment -

          Looks like I might be wrong on this. Let me run a cluster without doing any symlinks on the gateways. @Eric you might be right that we dont need any symlinks at all.

          Show
          Mahadev konar added a comment - Looks like I might be wrong on this. Let me run a cluster without doing any symlinks on the gateways. @Eric you might be right that we dont need any symlinks at all.
          Hide
          Mahadev konar added a comment - - edited

          @Eric,
          The symlink would still be needed if you were running bin/hadoop jar ... No? I dont think you can get away without creating the symlinks in that case. Though it would only be needed on the gateway node and not on the cluster nodes.

          Show
          Mahadev konar added a comment - - edited @Eric, The symlink would still be needed if you were running bin/hadoop jar ... No? I dont think you can get away without creating the symlinks in that case. Though it would only be needed on the gateway node and not on the cluster nodes.
          Hide
          Eric Yang added a comment -

          In the new layout, there is no need to create symlink for yarn jar files in common directory. I think the symlink section is no longer necessary with the new layout. Therefore, I removed that section. Could you be more specific about the flaws? Thanks

          Show
          Eric Yang added a comment - In the new layout, there is no need to create symlink for yarn jar files in common directory. I think the symlink section is no longer necessary with the new layout. Therefore, I removed that section. Could you be more specific about the flaws? Thanks
          Hide
          Mahadev konar added a comment -

          Yikes.. looks like the documentation update is incorrect (related to symlink creation). Ill update that before committing.

          Show
          Mahadev konar added a comment - Yikes.. looks like the documentation update is incorrect (related to symlink creation). Ill update that before committing.
          Hide
          Mahadev konar added a comment -

          Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.

          Show
          Mahadev konar added a comment - Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.
          Hide
          Mahadev konar added a comment -

          Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.

          Show
          Mahadev konar added a comment - Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.
          Hide
          Eric Yang added a comment -

          Patch build doesn't handle svn rename script, this is the reason pre-commit build fails on the patch test. The latest patch should be right and updated document.

          Apply procedure:

          svn-rename-MAPREDUCE-3366-3.sh
          patch -p0 < MAPREDUCE-3366-4-trunk.patch
          
          Show
          Eric Yang added a comment - Patch build doesn't handle svn rename script, this is the reason pre-commit build fails on the patch test. The latest patch should be right and updated document. Apply procedure: svn-rename-MAPREDUCE-3366-3.sh patch -p0 < MAPREDUCE-3366-4-trunk.patch
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12507108/MAPREDUCE-3366-4-trunk.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1428//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12507108/MAPREDUCE-3366-4-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1428//console This message is automatically generated.
          Eric Yang made changes -
          Attachment MAPREDUCE-3366-4-trunk.patch [ 12507108 ]
          Hide
          Eric Yang added a comment -

          Include updated documentation.

          Show
          Eric Yang added a comment - Include updated documentation.
          Jonathan Eagles made changes -
          Link This issue duplicates MAPREDUCE-3416 [ MAPREDUCE-3416 ]
          Hide
          Eric Yang added a comment -

          Mahadev, yes I will update the document for completeness. Thanks for the pointer.

          Show
          Eric Yang added a comment - Mahadev, yes I will update the document for completeness. Thanks for the pointer.
          Hide
          Mahadev konar added a comment -

          @Eric, I tried setting up a secure cluster as I used to earlier, looks like YARN_HOME needs to be set now, which is fine. Earlier it used to work without it - I think YARN_HOME used to default to MAPRED_HOME. But I think we need to make sure our documentation is correct. Could you please update the documentation (single node/multi node setup) to be in sync with the latest binary layout and environment setup?

          Show
          Mahadev konar added a comment - @Eric, I tried setting up a secure cluster as I used to earlier, looks like YARN_HOME needs to be set now, which is fine. Earlier it used to work without it - I think YARN_HOME used to default to MAPRED_HOME. But I think we need to make sure our documentation is correct. Could you please update the documentation (single node/multi node setup) to be in sync with the latest binary layout and environment setup?
          Hide
          Mahadev konar added a comment -

          I am trying to get it tested on secure cluster, will update on how that goes.

          Show
          Mahadev konar added a comment - I am trying to get it tested on secure cluster, will update on how that goes.
          Hide
          Alejandro Abdelnur added a comment -

          Tried the patch, layout seems OK, after setting all necessary ENV variables as well as minimal *-site.xml files I was able to start all services and run an example MR job.

          +1 (after comments from Eric are addressed)

          Show
          Alejandro Abdelnur added a comment - Tried the patch, layout seems OK, after setting all necessary ENV variables as well as minimal *-site.xml files I was able to start all services and run an example MR job. +1 (after comments from Eric are addressed)
          Hide
          Mahadev konar added a comment -

          @Eric,
          Could you please incorporate the documentation changes from MAPREDUCE-3416 as well?

          Show
          Mahadev konar added a comment - @Eric, Could you please incorporate the documentation changes from MAPREDUCE-3416 as well?
          Hide
          Eric Yang added a comment -

          Does this subsume MAPREDUCE-3416?

          Yes.

          Show
          Eric Yang added a comment - Does this subsume MAPREDUCE-3416 ? Yes.
          Bruno Mahé made changes -
          Labels bigtop
          Hide
          Tom White added a comment -

          Does this subsume MAPREDUCE-3416?

          Show
          Tom White added a comment - Does this subsume MAPREDUCE-3416 ?
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12506411/MAPREDUCE-3366-3-trunk.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1410//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12506411/MAPREDUCE-3366-3-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1410//console This message is automatically generated.
          Eric Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eric Yang made changes -
          Attachment svn-rename-MAPREDUCE-3366-3.sh [ 12506410 ]
          Attachment MAPREDUCE-3366-3-trunk.patch [ 12506411 ]
          Hide
          Eric Yang added a comment -
          • Revised patch to use proper libexec path.
          • Renamed start-all.sh/stop-all.sh to start-yarn.sh/stop-yarn.sh.

          Apply instruction:

          svn-rename-MAPREDUCE-3366-3.sh
          patch -p0 < MAPREDUCE-3366-3-trunk.patch
          
          Show
          Eric Yang added a comment - Revised patch to use proper libexec path. Renamed start-all.sh/stop-all.sh to start-yarn.sh/stop-yarn.sh. Apply instruction: svn-rename-MAPREDUCE-3366-3.sh patch -p0 < MAPREDUCE-3366-3-trunk.patch
          Mahadev konar made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Mahadev konar added a comment -

          @Eric,
          I am getting the same erros as Alejandro:

          sbin/yarn-daemon.sh: line 44: /X/workspace/install/hadoop-mapreduce/sbin/yarn-config.sh: No such file or directory
          starting resourcemanager, logging to /X/workspace/install/hadoop-mapreduce/logs/yarn-mahadev-resourcemanager.out
          /X/install/hadoop-mapreduce/bin/yarn: line 49: /X/workspace/install/hadoop-mapreduce/bin/yarn-config.sh: No such file or directory
          /System/Library/Frameworks/JavaVM.framework/Home/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dyarn.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dhadoop.log.file=yarn-mahadev-resourcemanager.log -Dyarn.log.file=yarn.log -Dyarn.home.dir=/X/workspace/install/hadoop-mapreduce -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /X/workspace/install/conf:/X/workspace/install/conf::/System/Library/Frameworks/JavaVM.framework/Home/lib/tools.jar --config /X/workspace/install/conf resourcemanager
          
          Show
          Mahadev konar added a comment - @Eric, I am getting the same erros as Alejandro: sbin/yarn-daemon.sh: line 44: /X/workspace/install/hadoop-mapreduce/sbin/yarn-config.sh: No such file or directory starting resourcemanager, logging to /X/workspace/install/hadoop-mapreduce/logs/yarn-mahadev-resourcemanager.out /X/install/hadoop-mapreduce/bin/yarn: line 49: /X/workspace/install/hadoop-mapreduce/bin/yarn-config.sh: No such file or directory /System/Library/Frameworks/JavaVM.framework/Home/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dyarn.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dhadoop.log.file=yarn-mahadev-resourcemanager.log -Dyarn.log.file=yarn.log -Dyarn.home.dir=/X/workspace/install/hadoop-mapreduce -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /X/workspace/install/conf:/X/workspace/install/conf::/System/Library/Frameworks/JavaVM.framework/Home/lib/tools.jar --config /X/workspace/install/conf resourcemanager
          Hide
          Alejandro Abdelnur added a comment -

          the patch applies and builds a distro, but the distro fails to start any of the MR services

          tucu@ubuntu:~/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT$ sbin/yarn-daemon.sh start resourcemanager
          sbin/yarn-daemon.sh: line 44: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/sbin/yarn-config.sh: No such file or directory
          starting resourcemanager, logging to /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs/yarn-tucu-resourcemanager-ubuntu.out
          /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn: line 49: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn-config.sh: No such file or directory
          /usr/lib/jvm/java-6-sun/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dyarn.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dhadoop.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar --config ~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/ resourcemanager
          Unrecognized option: --config
          Could not create the Java virtual machine.
          

          It seems the yarn-config.sh is being looked in bin/ instead of libexec/

          Show
          Alejandro Abdelnur added a comment - the patch applies and builds a distro, but the distro fails to start any of the MR services tucu@ubuntu:~/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT$ sbin/yarn-daemon.sh start resourcemanager sbin/yarn-daemon.sh: line 44: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/sbin/yarn-config.sh: No such file or directory starting resourcemanager, logging to /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs/yarn-tucu-resourcemanager-ubuntu.out /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn: line 49: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn-config.sh: No such file or directory /usr/lib/jvm/java-6-sun/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dyarn.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dhadoop.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar --config ~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/ resourcemanager Unrecognized option: --config Could not create the Java virtual machine. It seems the yarn-config.sh is being looked in bin/ instead of libexec/
          Hide
          Eric Yang added a comment -

          Summary Output from test-patch:

          There appear to be 0 release audit warnings before the patch and 0 release audit warnings after applying the patch.
          
          
          ======================================================================
          ======================================================================
              Checking the integrity of system test framework code.
          ======================================================================
          ======================================================================
          
          
          /bin/kill -9 12670
          kill: 12670: No such process
          NOP
          
          
          
          
          +1 overall.  
          
              +1 @author.  The patch does not contain any @author tags.
          
              +1 tests included.  The patch appears to include 1 new or modified tests.
          
              +1 javadoc.  The javadoc tool did not generate any warning messages.
          
              +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
          
              +1 findbugs.  The patch does not introduce any new Findbugs (version ) warnings.
          
              +1 release audit.  The applied patch does not increase the total number of release audit warnings.
          
          
          
          
          ======================================================================
          ======================================================================
              Finished build.
          ======================================================================
          ======================================================================
          
          Show
          Eric Yang added a comment - Summary Output from test-patch: There appear to be 0 release audit warnings before the patch and 0 release audit warnings after applying the patch. ====================================================================== ====================================================================== Checking the integrity of system test framework code. ====================================================================== ====================================================================== /bin/kill -9 12670 kill: 12670: No such process NOP +1 overall. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version ) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. ====================================================================== ====================================================================== Finished build. ====================================================================== ======================================================================
          Hide
          Mahadev konar added a comment -

          @Eric,
          The patch scripts has some issues working on cross project patches. Youll probably have to run the test-patch script manually.

          Show
          Mahadev konar added a comment - @Eric, The patch scripts has some issues working on cross project patches. Youll probably have to run the test-patch script manually.
          Hide
          Mahadev konar added a comment -

          @Eric,
          Thanks will try it out to see if everything is working - secure/unsecure.

          Show
          Mahadev konar added a comment - @Eric, Thanks will try it out to see if everything is working - secure/unsecure.
          Hide
          Eric Yang added a comment -

          I generated the patch from trunk directory. It doesn't seem to apply. What is the expected prefix for the patch build?

          Show
          Eric Yang added a comment - I generated the patch from trunk directory. It doesn't seem to apply. What is the expected prefix for the patch build?
          Hide
          Bruno Mahé added a comment -

          Great! Thanks a lot!

          Regarding merging all configurations in HADOOP_CONF_DIR, this definitely makes sense.

          Show
          Bruno Mahé added a comment - Great! Thanks a lot! Regarding merging all configurations in HADOOP_CONF_DIR, this definitely makes sense.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12506196/MAPREDUCE-3366-2-trunk.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1397//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12506196/MAPREDUCE-3366-2-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1397//console This message is automatically generated.
          Eric Yang made changes -
          Attachment MAPREDUCE-3366-2-trunk.patch [ 12506196 ]
          Hide
          Eric Yang added a comment -

          Updated LIBEXEC to match what was done in MAPREDUCE-3373.

          Show
          Eric Yang added a comment - Updated LIBEXEC to match what was done in MAPREDUCE-3373 .
          Hide
          Eric Yang added a comment -

          Bruno, you are right. Thanks for catching this. I will updated it to reflect changes in MAPREDUCE-3373.

          Why changing these lines:

          -YARN_CONF_DIR="${YARN_CONF_DIR:-$YARN_HOME/conf}"

          +YARN_CONF_DIR="${HADOOP_CONF_DIR:-$YARN_HOME/conf}

          This was done as part of merging back Hadoop into a project. There are many configuration files which have interconnected parts. i.e. log4j, hadoop-metric2.properties. It seems safer to consolidate config files back to
          HADOOP_CONF_DIR, and reduce redundancies or conflicts. For consistency, HDFS use HADOOP_CONF_DIR rather than
          HDFS_CONF_DIR. Yarn should follow the same pattern in my opinion.

          Mahadev, yes, this subsume MAPREDUCE-3177.

          Show
          Eric Yang added a comment - Bruno, you are right. Thanks for catching this. I will updated it to reflect changes in MAPREDUCE-3373 . Why changing these lines: -YARN_CONF_DIR="${YARN_CONF_DIR:-$YARN_HOME/conf}" +YARN_CONF_DIR="${HADOOP_CONF_DIR:-$YARN_HOME/conf} This was done as part of merging back Hadoop into a project. There are many configuration files which have interconnected parts. i.e. log4j, hadoop-metric2.properties. It seems safer to consolidate config files back to HADOOP_CONF_DIR, and reduce redundancies or conflicts. For consistency, HDFS use HADOOP_CONF_DIR rather than HDFS_CONF_DIR. Yarn should follow the same pattern in my opinion. Mahadev, yes, this subsume MAPREDUCE-3177 .
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12506181/MAPREDUCE-3366-1-trunk.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1394//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12506181/MAPREDUCE-3366-1-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1394//console This message is automatically generated.
          Hide
          Mahadev konar added a comment -

          Great to see this Eric. Does this subsume MAPREDUCE-3177?

          Show
          Mahadev konar added a comment - Great to see this Eric. Does this subsume MAPREDUCE-3177 ?
          Hide
          Bruno Mahé added a comment -

          Here are some issues with that patch:

          • In hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh :
            Instead of using the hardcoded value "$bin/../", it would be eaiser to reuse what has been done in MAPREDUCE-3373.
            For instance:
            +DEFAULT_LIBEXEC_DIR="$bin"/../libexec
            +HADOOP_LIBEXEC_DIR=$ {HADOOP_LIBEXEC_DIR:-$DEFAULT_LIBEXEC_DIR}
            +if [ -e "${HADOOP_LIBEXEC_DIR}

            /hadoop-config.sh" ]; then
            + . "$

            {HADOOP_LIBEXEC_DIR}

            /hadoop-config.sh"

          • Wouldn't it be less confusing to display the message "hadoop-config.sh not found" instead of "Hadoop common not found." if hadoop-config.sh is not found?
          • Why changing these lines:
            -YARN_CONF_DIR="$ {YARN_CONF_DIR:-$YARN_HOME/conf}

            "
            +YARN_CONF_DIR="$

            {HADOOP_CONF_DIR:-$YARN_HOME/conf}

          I would like to be able to specify a different YARN_CONF_DIR than HADOOP_CONF_DIR whole not being in YARN_HOME/conf. This change reduces the choices

          Show
          Bruno Mahé added a comment - Here are some issues with that patch: In hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh : Instead of using the hardcoded value "$bin/../", it would be eaiser to reuse what has been done in MAPREDUCE-3373 . For instance: +DEFAULT_LIBEXEC_DIR="$bin"/../libexec +HADOOP_LIBEXEC_DIR=$ {HADOOP_LIBEXEC_DIR:-$DEFAULT_LIBEXEC_DIR} +if [ -e "${HADOOP_LIBEXEC_DIR} /hadoop-config.sh" ]; then + . "$ {HADOOP_LIBEXEC_DIR} /hadoop-config.sh" Wouldn't it be less confusing to display the message "hadoop-config.sh not found" instead of "Hadoop common not found." if hadoop-config.sh is not found? Why changing these lines: -YARN_CONF_DIR="$ {YARN_CONF_DIR:-$YARN_HOME/conf} " +YARN_CONF_DIR="$ {HADOOP_CONF_DIR:-$YARN_HOME/conf} I would like to be able to specify a different YARN_CONF_DIR than HADOOP_CONF_DIR whole not being in YARN_HOME/conf. This change reduces the choices
          Eric Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Eric Yang added a comment -

          The same trunk patch can apply cleanly to 0.23 branch for now.

          Show
          Eric Yang added a comment - The same trunk patch can apply cleanly to 0.23 branch for now.
          Eric Yang made changes -
          Attachment MAPREDUCE-3366-1-trunk.patch [ 12506181 ]
          Hide
          Eric Yang added a comment -

          Updated patch for trunk with ApplicationConstants.java fixed.

          Show
          Eric Yang added a comment - Updated patch for trunk with ApplicationConstants.java fixed.
          Mahadev konar made changes -
          Link This issue is duplicated by MAPREDUCE-3177 [ MAPREDUCE-3177 ]
          Hitesh Shah made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Hitesh Shah added a comment -

          For MR jobs to work properly with the above change, APPLICATION_CLASSPATH in ApplicationConstants.java will also likely need to be changed.

          Show
          Hitesh Shah added a comment - For MR jobs to work properly with the above change, APPLICATION_CLASSPATH in ApplicationConstants.java will also likely need to be changed.
          Eric Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eric Yang made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Eric Yang added a comment -

          Patch build didn't work for some other reasons, cancel patch and retest.

          Show
          Eric Yang added a comment - Patch build didn't work for some other reasons, cancel patch and retest.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12503105/MAPREDUCE-3366.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1284//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503105/MAPREDUCE-3366.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1284//console This message is automatically generated.
          Eric Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eric Yang made changes -
          Attachment MAPREDUCE-3366.patch [ 12503105 ]
          Hide
          Eric Yang added a comment -

          Map YARN directory structure to the same layout as HDFS/common.

          Show
          Eric Yang added a comment - Map YARN directory structure to the same layout as HDFS/common.
          Eric Yang made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-7410 [ HADOOP-7410 ]
          Eric Yang created issue -

            People

            • Assignee:
              Eric Yang
              Reporter:
              Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development