Uploaded image for project: 'Yetus'
  1. Yetus
  2. YETUS-15

build environment

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.1.0
    • 0.9.0
    • Precommit
    • None
    • Hide
      <!-- markdown -->
      Apache Yetus has been converted to use Apache Maven as a build tool. As a result, many changes have taken place that directly impacts the project.

      * Source directories have been re-arranged and re-named:
        * All bash code is now in (feature)/src/main/shell
        * All python code is now in (feature)/src/main/python
      * audience-annotations is mostly unchanged.
      * releasedocmaker and shelldocs are now available as Jython-built jars.
      * Introduction of the yetus-minimaven-plugin and yetus-maven-plugins. The yetus-minimaven-plugin is used to build Apache Yetus. yetus-maven-plugin is an end-user artifact that gives access some Apache Yetus features to Apache Maven and compatible build systems without needing any external help (e.g., yetus-wrapper)
      * Middleman is still used for creating the static website, however, it is now tied into the 'mvn site' command. 'mvn install' MUST be executed before running 'mvn site' as website generation depends upon the yetus-minimaven-plugin.
      * The content of yetus-project is now in the root of the source tree.
      * The new yetus-dist module handles the creation of a complete distribution. The artifacts are now in the yetus-dist/target directory. The artifact contents are largely unchanged. New yetus-assemblies module and various Apache Maven configuration files have been added to create distribution parity.
      * The website is also available as a tar.gz tarball in the yetus-dist artifact area.
      * The jdiff module is now always built.
      * Version handling has been modified in several different locations and the executables themselves.

      Also, other changes introduced:

      * start-build-env.sh has been added to create a Docker-ized development environment. In particular, this imports the .ssh and .gnupg directories and has all pre-requisites for building Apache Yetus and making releases.
      * A Dockerfile in root has been added for hub.docker.com and CI-system integration.
      * The old Dockerfile (previously located at precommit/test-patch-docker and now located at precommit/src/main/shell/test-patch-docker) has been changed to be able also to run releasedocmaker.
      * Some ruby dependencies for the website have been updated for security reasons.
      * JDK8 is now the minimum version of Java used to build the Apache Yetus Java components.
      * precommit's shellcheck.sh now recognizes src/main/shell as containing shell code to check.
      * releasedocmaker and shelldocs now explicitly call for python2
      Show
      <!-- markdown --> Apache Yetus has been converted to use Apache Maven as a build tool. As a result, many changes have taken place that directly impacts the project. * Source directories have been re-arranged and re-named:   * All bash code is now in (feature)/src/main/shell   * All python code is now in (feature)/src/main/python * audience-annotations is mostly unchanged. * releasedocmaker and shelldocs are now available as Jython-built jars. * Introduction of the yetus-minimaven-plugin and yetus-maven-plugins. The yetus-minimaven-plugin is used to build Apache Yetus. yetus-maven-plugin is an end-user artifact that gives access some Apache Yetus features to Apache Maven and compatible build systems without needing any external help (e.g., yetus-wrapper) * Middleman is still used for creating the static website, however, it is now tied into the 'mvn site' command. 'mvn install' MUST be executed before running 'mvn site' as website generation depends upon the yetus-minimaven-plugin. * The content of yetus-project is now in the root of the source tree. * The new yetus-dist module handles the creation of a complete distribution. The artifacts are now in the yetus-dist/target directory. The artifact contents are largely unchanged. New yetus-assemblies module and various Apache Maven configuration files have been added to create distribution parity. * The website is also available as a tar.gz tarball in the yetus-dist artifact area. * The jdiff module is now always built. * Version handling has been modified in several different locations and the executables themselves. Also, other changes introduced: * start-build-env.sh has been added to create a Docker-ized development environment. In particular, this imports the .ssh and .gnupg directories and has all pre-requisites for building Apache Yetus and making releases. * A Dockerfile in root has been added for hub.docker.com and CI-system integration. * The old Dockerfile (previously located at precommit/test-patch-docker and now located at precommit/src/main/shell/test-patch-docker) has been changed to be able also to run releasedocmaker. * Some ruby dependencies for the website have been updated for security reasons. * JDK8 is now the minimum version of Java used to build the Apache Yetus Java components. * precommit's shellcheck.sh now recognizes src/main/shell as containing shell code to check. * releasedocmaker and shelldocs now explicitly call for python2
    • Important

    Description

      We need to have some way to build (esp the documentation!) and unit tests.

      Attachments

        1. HADOOP-12137.HADOOP-12111.00.patch
          451 kB
          Allen Wittenauer
        2. HADOOP-12137.HADOOP-12111.01.patch
          473 kB
          Allen Wittenauer
        3. YETUS-15.000.patch
          15 kB
          Casey Brotherton
        4. YETUS-15.002.patch
          137 kB
          Allen Wittenauer
        5. YETUS-15.004.patch
          212 kB
          Allen Wittenauer
        6. YETUS-15.005.patch
          224 kB
          Allen Wittenauer
        7. YETUS-15.006.patch
          227 kB
          Allen Wittenauer
        8. YETUS-15.007.patch
          236 kB
          Allen Wittenauer
        9. YETUS-15.008.patch
          237 kB
          Allen Wittenauer
        10. YETUS-15.009.patch
          238 kB
          Allen Wittenauer
        11. YETUS-15.010.patch
          253 kB
          Allen Wittenauer
        12. YETUS-15.011.patch
          278 kB
          Allen Wittenauer
        13. YETUS-15.03.patch
          210 kB
          Allen Wittenauer
        14. YETUS-15.ea-maven-001.patch
          112 kB
          Allen Wittenauer

        Issue Links

          Activity

            People

              aw Allen Wittenauer
              aw Allen Wittenauer
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: