[BEAM-14467] Failed test annotated with no_xdist passes github action python test

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: build-system
• Assignee: Brian Hulette
• Reporter: Yi Hu
• Created: 12/May/22 21:07
• Updated: 17/May/22 18:36
• Resolved: 17/May/22 18:36

Description

A python unit test annotated with @pytest.mark.no_xdist does not cause GIthub Action check fails even though the test fails. See https://github.com/apache/beam/pull/17649 for example. The test is executed and failed which can be seen in log.

    def test_expected_failure(self):
>     assert False
E     AssertionError: assert False

apache_beam/pvalue_test.py:56: AssertionError
- generated xml file: /home/runner/work/beam/beam/sdks/python/pytest_py37_no_xdist.xml -
====== 1 failed, 71 passed, 12 skipped, 5389 deselected in 11.71 seconds =======

Issue Links

• links to: GitHub Pull Request #17687