Uploaded image for project: 'Apache Hop (Retired)'
  1. Apache Hop (Retired)
  2. HOP-3929

Improve build performance of modules

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Normal
    • Resolution: Fixed
    • None
    • None
    • Build
    • None

    Description

      Hi, I'm now using hop. I found that the build time of the project is not very fast when I used  mvn -T 1C install -DskipTests command to build the project during Github Actions. So I try to speed up the build performance of the project. The goal here is to clean up dependencies between maven modules in the project in order to improve the build performance.

      Thread usage before cleaning up module dependencies was this:

      Using mvn dependency:analyze command I managed to have an overview of the unused dependencies of every module. I focused only on the dependencies between modules. The following dependencies can be cleaned up:

      org.apache.hop:hop-client -> org.apache.hop:hop-assemblies-plugins-dist
      org.apache.hop:hop-assemblies-web -> org.apache.hop:hop-assemblies-plugins-dist
      org.apache.hop:hop-assemblies-plugins-dist -> org.apache.hophop-assemblies-plugins-engines-beam

      After clean up, the build time has been reduced by 1min when I use parallel build during Github Actions.
      Thread usage after cleaning up module dependencies was this:

      Could you help me review this issue? I can submit a PR to improve build performance of the project.

      Thank you very much for your attention.
      Best regards.

      Attachments

        Activity

          People

            Unassigned Unassigned
            Bing-ok Bing-ok
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: