Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3863

0.22 branch mvn deploy is not publishing hadoop-streaming JAR

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.22.0, 0.22.1
    • Fix Version/s: 0.22.1
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Without this JAR Oozie cannot be built/tested against 0.22

      1. MAPREDUCE-3863.patch
        9 kB
        Benoy Antony
      2. MAPREDUCE-3863.patch
        9 kB
        Benoy Antony
      3. MAPREDUCE-3863.patch
        9 kB
        Benoy Antony

        Issue Links

          Activity

          Hide
          Benoy Antony added a comment -

          The patch involves the following :

          1. correcting the name of the jar so that version and build number comes after streaming.
          2. adding a template for streaming pom file
          3. changes to mapreduce/build.xml to publish the jar to repo.

          Show
          Benoy Antony added a comment - The patch involves the following : 1. correcting the name of the jar so that version and build number comes after streaming. 2. adding a template for streaming pom file 3. changes to mapreduce/build.xml to publish the jar to repo.
          Hide
          Benoy Antony added a comment -

          Replace jar and jar-test with all-jars for mvn-installa and mvn-deploy.
          This is needed because streaming jar need to get built along with mapreduce jars.

          Show
          Benoy Antony added a comment - Replace jar and jar-test with all-jars for mvn-installa and mvn-deploy. This is needed because streaming jar need to get built along with mapreduce jars.
          Hide
          Benoy Antony added a comment -

          Attaching the patch with --no-prefix option

          Show
          Benoy Antony added a comment - Attaching the patch with --no-prefix option
          Hide
          Konstantin Boudnik added a comment -

          Patch looks good. Unfortunately, I wasn't been able to validate it is working as expected because I can't compile gridmix on my system as it aborts on some generics complication issues.

          According to a multiple confirmations from other ppl. looks like that the patch actually fixes the problem in some production environments. So, I am committing this with an official
          +1

          Show
          Konstantin Boudnik added a comment - Patch looks good. Unfortunately, I wasn't been able to validate it is working as expected because I can't compile gridmix on my system as it aborts on some generics complication issues. According to a multiple confirmations from other ppl. looks like that the patch actually fixes the problem in some production environments. So, I am committing this with an official +1
          Hide
          Konstantin Boudnik added a comment -

          I have just committed it. Thank you, Antony!

          Show
          Konstantin Boudnik added a comment - I have just committed it. Thank you, Antony!
          Hide
          Konstantin Boudnik added a comment -

          I am going to assign the ticket to myself, as I don't see Antony in the list contributors yet.

          Show
          Konstantin Boudnik added a comment - I am going to assign the ticket to myself, as I don't see Antony in the list contributors yet.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-22-branch #102 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/102/)
          MAPREDUCE-3863. 0.22 branch mvn deploy is not publishing hadoop-streaming JAR. Contributed by Benoy Antony (Revision 1330126)

          Result = SUCCESS
          cos : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1330126
          Files :

          • /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
          • /hadoop/common/branches/branch-0.22/mapreduce/build.xml
          • /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/streaming/build.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-22-branch #102 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/102/ ) MAPREDUCE-3863 . 0.22 branch mvn deploy is not publishing hadoop-streaming JAR. Contributed by Benoy Antony (Revision 1330126) Result = SUCCESS cos : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1330126 Files : /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt /hadoop/common/branches/branch-0.22/mapreduce/build.xml /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/streaming/build.xml
          Hide
          Konstantin Shvachko added a comment -

          Cos, you missed the new file hadoop-streaming-template.xml in the previous commit. I just committed it. Reassigning this to Benoy.

          Show
          Konstantin Shvachko added a comment - Cos, you missed the new file hadoop-streaming-template.xml in the previous commit. I just committed it. Reassigning this to Benoy.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-22-branch #103 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/103/)
          MAPREDUCE-3863. hadoop-streaming-template.xml is missing in the previous commit. (Revision 1333256)

          Result = SUCCESS
          shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1333256
          Files :

          • /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-streaming-template.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-22-branch #103 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/103/ ) MAPREDUCE-3863 . hadoop-streaming-template.xml is missing in the previous commit. (Revision 1333256) Result = SUCCESS shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1333256 Files : /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-streaming-template.xml

            People

            • Assignee:
              Benoy Antony
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development