[CASSANDRA-19464] pytest >= 8.1.0 breaks flaky plugin in cassandra-dtests

• Type: Task
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Fix Version/s: NA
• Component/s: Test/dtest/python
• Change Category: Operability
• Complexity: Normal
• Platform: All

Test and Documentation Plan

ci

• Assignee: Stefan Miklosovic
• Reporter: Stefan Miklosovic

Authors

Stefan Miklosovic

Reviewers

Berenguer Blasi

• Created: 09/Mar/24 20:16
• Updated: 11/Mar/24 09:21

Description

I just hit this issue literally today / yesterday. Python's dtests started to fail on some super strange errors like this (1) and similar ...

We have "pytest>=6.5.0" in requirements.txt for Python dtests so it seems like it automatically updates to whatever is the latest and it just updated to 8.1.1 and it broke the stuff.

Some basic investigation yields (2), (3) were complaints are made that it break a lot of things.

The proper solution seems to be to remove flaky and transition to (4).

Until we fix this, I think we might just downgrade to the latest 8.0.x pytest, probably this one (5), I am just trying it as I write this.

(1) https://app.circleci.com/pipelines/github/instaclustr/cassandra/3978/workflows/57f7db32-9892-40bd-9e85-cc9527af7af7/jobs/201511
(2) https://github.com/pytest-dev/pytest/issues/12066
(3) https://docs.pytest.org/en/latest/changelog.html#pytest-8-1-0-yanked
(4) https://github.com/pytest-dev/pytest-rerunfailures
(5) https://docs.pytest.org/en/latest/changelog.html#pytest-8-0-2-2024-02-24