HBase
  1. HBase
  2. HBASE-6342

Setup apache jenkins trunk builds with stable and flaky builds

    Details

    • Type: Task Task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HBase trunk builds (and several others) have a set of known flaky tests. We could setup the current jenkins builds, or the hadoopqa builds to run the known good set separately from the flaky set.

      This would be helpful because it would expose known flaky tests, reduce the noise due to flapping test runs, and potentially improve our discipline with unit tests and CI going forwards.

        Activity

        Hide
        David S. Wang added a comment -

        Thanks for looking at this, Jon.

        I think both the flaky test lists and script modifications should go into the repository, as they should be treated as first-class changes if we do this.

        Show
        David S. Wang added a comment - Thanks for looking at this, Jon. I think both the flaky test lists and script modifications should go into the repository, as they should be treated as first-class changes if we do this.
        Hide
        Jonathan Hsieh added a comment -

        I've gotten this setup with the older 0.90/0.92/0.94 builds. I haven't tested the excludes portion with the newer post-modularization trunk build yet.

        Some questions:

        • Where do the flaky test lists go? (in repo?)
        • If we modify the jenkins scripts, should they go in repo as well? (my vote is yes).
        Show
        Jonathan Hsieh added a comment - I've gotten this setup with the older 0.90/0.92/0.94 builds. I haven't tested the excludes portion with the newer post-modularization trunk build yet. Some questions: Where do the flaky test lists go? (in repo?) If we modify the jenkins scripts, should they go in repo as well? (my vote is yes).

          People

          • Assignee:
            Unassigned
            Reporter:
            Jonathan Hsieh
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development