Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-6102

Better isolation for CI jobs an ASF Jenkins

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 5.1.0, 4.16.0
    • None
    • None

    Description

      Currently we are running the CI jobs on ASF infrastructure as simple unix applications, and are sharing the machines with different projects (and different instances of our jobs).

      This results in quite a few problems:

      • Clobbering other jobs/getting clobbered by buggy cleanup efforts in scripts
      • Causing/Suffering from resource starvation
      • Conflicts in shared maven local repositories (f.e. HBase recompile)

      The obvious solution to (some) of these problems is utilising Jenkins's docker support. 

      One problem with that approach is that we lose the efficiency of a persistent local maven repo as a cache. We may try to modify the maven setup to use that, or we can accept the performance hit, considering that our jobs are very long, so the additional time/traffic generated is not a deal breaker.

      Attachments

        Issue Links

          Activity

            People

              stoty Istvan Toth
              stoty Istvan Toth
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h