Lucene - Core
  1. Lucene - Core
  2. LUCENE-3784 Switching tests infrastructure to randomizedtesting.*
  3. LUCENE-3808

Switch LuceneTestCaseRunner to RandomizedRunner. Enforce Random sharing contracts. Enforce thread leaks.

    Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0-ALPHA
    • Component/s: general/test
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

      Switch the runner to RandomizedRunner. Enforce the following:

      • Random sharing will result in a failure/ exception.
      • Add a validator for testXXX without @Test annotation. (custom test provider added).
      • Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
      • Add a validator for static hook shadowing (no-no).
      • Modify custom execution groups in LTC to be real @Groups.

      Follow up from merging with trunk:

      • rename tests.threadspercpu into tests.jvms (Steve)
      • align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
      • the output is emitted twice in case of suite-level errors.

        Issue Links

          Activity

          Dawid Weiss created issue -
          Dawid Weiss made changes -
          Field Original Value New Value
          Description Switch the runner to RandomizedRunner. Enforce the following:
          - Random sharing will result in a failure/ exception.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - Add a validator for testXXX without @Test annotation.
          - Modify custom execution groups in LTC to be real @Groups.
          Switch the runner to RandomizedRunner. Enforce the following:
          - Random sharing will result in a failure/ exception.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - -Add a validator for testXXX without @Test annotation.-
          - Modify custom execution groups in LTC to be real @Groups.
          Dawid Weiss made changes -
          Description Switch the runner to RandomizedRunner. Enforce the following:
          - Random sharing will result in a failure/ exception.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - -Add a validator for testXXX without @Test annotation.-
          - Modify custom execution groups in LTC to be real @Groups.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - Modify custom execution groups in LTC to be real @Groups.
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - Modify custom execution groups in LTC to be real @Groups.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - Modify custom execution groups in LTC to be real @Groups.
          Dawid Weiss made changes -
          Link This issue incorporates LUCENE-3785 [ LUCENE-3785 ]
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - Thread leaks will result in a failure (add lingering if needed, but no ignores).
          - Add a validator for @Test method overrides (no-no).
          - Add a validator for static hook shadowing (no-no).
          - Modify custom execution groups in LTC to be real @Groups.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores). [this is done, but disabled]
          - Add a validator for @Test method overrides (check how many of these we already have first).
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores). [this is done, but disabled]
          - Add a validator for @Test method overrides (check how many of these we already have first).
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores). [this is done, but disabled]
          - Add a validator for @Test method overrides (check how many of these we already have first).
          - What to do with thread-shared Random instances copies in MockIndexWriter and MockAnalyzer?
          Dawid Weiss made changes -
          Link This issue incorporates LUCENE-3429 [ LUCENE-3429 ]
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          - Thread leaks will result in a failure (add lingering if needed, but no ignores). [this is done, but disabled]
          - Add a validator for @Test method overrides (check how many of these we already have first).
          - What to do with thread-shared Random instances copies in MockIndexWriter and MockAnalyzer?
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert)
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert)
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert)
          - the output is emitted twice in case of suite-level errors.
          Dawid Weiss made changes -
          Link This issue incorporates LUCENE-3988 [ LUCENE-3988 ]
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert)
          - the output is emitted twice in case of suite-level errors.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
          - the output is emitted twice in case of suite-level errors.
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
          - the output is emitted twice in case of suite-level errors.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - (/) rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
          - the output is emitted twice in case of suite-level errors.
          Dawid Weiss made changes -
          Description Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - (/) rename tests.threadspercpu into tests.jvms (Steve)
          - align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
          - the output is emitted twice in case of suite-level errors.
          Dev. branch at: https://github.com/dweiss/lucene_solr/tree/rr

          Switch the runner to RandomizedRunner. Enforce the following:
          - (/) Random sharing will result in a failure/ exception.
          - (/) -Add a validator for testXXX without @Test annotation.- (custom test provider added).
          - (/) Make sure tests are executed with assertions enabled (at least for solr/lucene packages).
          - (/) Add a validator for static hook shadowing (no-no).
          - (/) Modify custom execution groups in LTC to be real @Groups.

          Follow up from merging with trunk:
          - (/) rename tests.threadspercpu into tests.jvms (Steve)
          - (/) align to 80 cols terminals (Robert) - use simple class names and add truncation padding.
          - (/) the output is emitted twice in case of suite-level errors.
          Dawid Weiss made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Dawid Weiss
              Reporter:
              Dawid Weiss
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development