[BEAM-14330] google.api_core.exceptions.MethodNotImplemented when tests run in parallel

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: runner-py-interactive
• Assignee: Ning
• Reporter: Ning
• Created: 19/Apr/22 20:58
• Updated: 20/Apr/22 22:39
• Resolved: 20/Apr/22 22:39

Description

An error is thrown when tests run in parallel for interactive modules.

>google.api_core.exceptions.MethodNotImplemented: 501 Received http2 header with status: 404

 

The cause is shared global singleton among tests: a cluster related test registers a cluster manager in the global state while a non-cluster test cleans up the global state without necessary mocking.

The solution should be mock the global singleton in tests to isolate tests from each other.

To reproduce the failure (note: parallel execution is non-deterministic), add something like '-n 5' when executing pytests.

For example:

>pytest -n 5 apache_beam/runners/interactive/interactive_runner_test.py

Issue Links

• is a child of: BEAM-14332 Improve the workflow of cluster management for Flink on Dataproc
• links to: GitHub Pull Request #17400