Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2947

Project Frontier: Bigtop Integration Test Framework 2.0

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.1
    • Fix Version/s: 1.4.0
    • Component/s: None
    • Labels:
      None

      Description

      The Project Frontier focuses on extending and harden the feature that Bigtop was originally designed for: Build Hadoop Distributions. Bigtop can only produce high quality distributions if working with upstream projects closely to solve integration problems across multiple Hadoop ecosystem projects.

      Ref: https://www.odpi.org/blog/2017/10/17/checking-in-apache-bigtop-test-drive-grant-recipients-work-in-full-swing

        Attachments

        1.
        Add gradle task which leverage bigtop-ci/build.sh to build packages Sub-task Resolved Evans Ye  
        2.
        bigtop/bigtop-tests/smoke-tests/run_itest.sh is broken Sub-task Resolved Evans Ye  
        3.
        Add pre requisite check task to check docker environment Sub-task Resolved Unassigned  
        4.
        Switch to gradle XXX-pkg-ind feature developed in BIGTOP-2949 for Bigtop CI Sub-task Resolved Evans Ye  
        5.
        Document the new feature added in BIGTOP-2949 Sub-task Resolved Evans Ye  
        6.
        Add example CI pipeline to build end-to-end from a commit to smoke test Sub-task Resolved Evans Ye  
        7.
        Extend Provisioner CI matrix to run smoke tests Sub-task Resolved Unassigned  
        8.
        Update Smoke Test CI matrix against Bigtop master Distros Sub-task Resolved Evans Ye  
        9.
        Add AARCH64 in Provisioner CI matrix Sub-task Resolved Jun He  
        10.
        Support configure-nexus for gradle COMPONENT-pkg-ind Sub-task Resolved Unassigned  
        11.
        Add gradle repo-ind Sub-task Resolved Evans Ye  
        12.
        Release number is not honored by the build system Sub-task Resolved Evans Ye  
        13.
        Better user expereince when calling docker-hadoop.sh -d with no cluster running Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        14.
        Nexus proxy cache configuration is broken Sub-task Resolved Olaf Flebbe  
        15.
        Error out when configure-nexus encounter any issue Sub-task Resolved Evans Ye  
        16.
        Support to enable Nexus proxy for Docker Provisioner Sub-task Resolved Evans Ye  
        17.
        [Provisioner] Raise proper exit code and error messages when provisioning failed Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        18.
        Switch to docker cp based solution to build inside containers Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        19.
        [Provisioner] Failed to bootstrap provisioning environment on Debian/Ubuntu Sub-task Resolved Evans Ye  
        20.
        Setup manual smoke test for Pull Requests Sub-task Resolved Evans Ye  
        21.
        Failed to start Ambari server and agent on Fedora 26 Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 20m
        22.
        [Test] Fix test specification with maven failsafe plugin Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 1h
        23.
        Failed to deploy Alluxio due to Puppet compatibility issue Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        24.
        [Provisioner] Treat both exit code 0 and 2 as success for Puppet execution Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        25.
        Upgrade to Puppet 5.X Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 20m
        26.
        Update Kerberos module to comply with Puppet's syntax Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 20m
        27.
        Nexus is always enabled for ./gradlew XXX-ind Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        28.
        Enable local repo is not working on yum systems Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        29.
        Loop and wait for daemon to be started up for Alluxio Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        30.
        [Provisioner] Support to specify components and smoke-tests when launching Docker Provisioner Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        31.
        Fix bugs and improve usability of COMPONENT-pkg-ind Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        32.
        ./gradlew repo-ind failed on Bigtop build slaves Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        33.
        [Build] Support to specify commit SHA1 when building packages Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        34.
        [Build] Support non X86 archs for COMPONENT-pkg-ind Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        35.
        [Build] Exit w/o container left dangling when running docker in gradle wrapper Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        36.
        Connection refused by www-us.apache.org mirror site Sub-task Resolved Evans Ye  
        37.
        Gradle 5 incompatible issue Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        38.
        Build as non-root for COMPONENT-pkg-ind Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        39.
        Helper message and documentation of new XXX-ind features Sub-task Resolved Evans Ye  
        40.
        Allow to specify more properties/options at command line for docker provisioner Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        41.
        Add REPO and MEMORY as options for docker-provisioner Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        42.
        Add pkgs-ind to package all artifacts inside docker Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        43.
        [Docker] Treat both exit code 0 and 2 as success for Puppet execution Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        44.
        Can not run smoke test inside docker-provisioner Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        45.
        Bugfix Integration test framework 2.0 and documentation Sub-task Resolved Evans Ye

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h

          Activity

            People

            • Assignee:
              evans_ye Evans Ye
              Reporter:
              evans_ye Evans Ye
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 8h 20m
                8h 20m